00000001:02000400:0.0F:1788744398.851947:0:2964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_hostid 00000001:02000400:0.0:1788744421.688584:0:3185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788744423.887746:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 892 MB/s 00000001:01000000:2.0:1788744424.140531:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 640 MB/s 00000001:01000000:2.0:1788744424.390218:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4763 MB/s 00000020:02000000:2.0:1788744425.329376:0:3276:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_40_g869f601 00000400:02000000:3.0F:1788744426.540829:0:3290:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.106@tcp [8/256/0/180] 00008000:02000000:0.0:1788744430.416708:0:3440:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788744482.746168:0:5244:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788744493.042926:0:5821:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788744493.042943:0:5821:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788744493.043208:0:5821:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ad690a5b 00000080:02000400:2.0:1788744493.043218:0:5821:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788744493.051522:0:5821:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788744493.051540:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788744493.051909:0:5821:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b1ce2554) 00000020:00000080:3.0:1788744493.052087:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788744493.080524:0:5821:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788744493.080911:0:5821:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788744493.119707:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788744493.119764:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788744493.119787:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788744493.119837:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788744493.119865:0:5821:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788744493.120278:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788744493.120285:0:5821:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788744493.120296:0:5821:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b162761eb391c0d 00000020:01000004:0.0:1788744493.120303:0:5821:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788744493.120308:0:5821:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788744493.120312:0:5821:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ad690a5b from MGS 00000020:01000004:0.0:1788744493.120316:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788744493.120344:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000003b2d4aa) 00000020:00000080:0.0:1788744493.120356:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788744493.120425:0:5821:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ad690a5b from MGS, refs=2 00080000:01000000:0.0:1788744493.120431:0:5821:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788744493.120436:0:5821:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b162761eb391c1b 00000100:00100000:0.0:1788744493.120531:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788744493.120686:0:5821:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788744493.120699:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788744493.121839:0:5821:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788744493.121851:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788744493.122611:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744493.122806:0:5821:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788744493.122813:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788744493.125523:0:5821:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788744493.125539:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788744493.126943:0:5821:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788744493.126955:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788744493.129513:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744493.129520:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744493.129522:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744493.130690:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744493.130694:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744493.130696:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744493.131348:0:5821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788744493.135151:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788744493.380243:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2411 MB/s 00000001:01000000:3.0:1788744493.631779:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2342 MB/s 00000001:01000000:0.0:1788744493.889293:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 410 MB/s 00000001:01000000:2.0:1788744494.141226:0:5821:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 666 MB/s 00080000:10000000:2.0:1788744494.151969:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788744494.177229:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788744494.177247:0:5821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788744494.177250:0:5821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788744494.181743:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788744494.181823:0:5821:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788744494.181899:0:5821:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788744494.182228:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788744494.182256:0:5821:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788744494.191717:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744494.192074:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788744494.192081:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0F:1788744494.195585:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788744494.195737:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788744494.196360:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788744494.196367:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788744494.197113:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788744494.197169:0:5821:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.106@tcp' 00000020:01000004:3.0:1788744494.197171:0:5821:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788744494.197216:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.106@tcp (typ=mgc) 00000020:00000080:3.0:1788744494.197229:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.106@tcp (000000006b6e18b1) 00000020:00000080:3.0:1788744494.197244:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788744494.197329:0:5821:0:(ldlm_lib.c:103:import_set_conn()) imp 00000000e56d2e36@MGC192.168.201.106@tcp: add connection 192.168.201.106@tcp at head 00010000:00010000:2.0:1788744494.197805:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744494.199101:0:5821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.106@tcp-0 is initialized 00000040:01000000:3.0:1788744494.199111:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788744494.199664:0:5837:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788744494.199711:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.106@tcp (uuid 754bab6b-7807-4d58-8a45-456ed56af02a) 00000020:00000080:1.0:1788744494.199745:0:5821:0:(genops.c:1384:class_connect()) connect: client 754bab6b-7807-4d58-8a45-456ed56af02a, cookie 0x4b162761eb391c29 00000100:00080000:1.0:1788744494.199757:0:5821:0:(import.c:545:import_select_connection()) MGC192.168.201.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744494.199764:0:5821:0:(import.c:666:import_select_connection()) MGC192.168.201.106@tcp: import 00000000e56d2e36 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1788744494.199804:0:5821:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000080de7bd2 x1875634475237504/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744494.200249:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080de7bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:754bab6b-7807-4d58-8a45-456ed56af02a:3306:1875634475237504:0@lo:250: 00000100:00100000:1.0:1788744494.200342:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788744494.200400:0:5821:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 754bab6b-7807-4d58-8a45-456ed56af02a->MGS 00000020:01000004:1.0:1788744494.200416:0:5821:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788744494.200422:0:5821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788744494.200441:0:5821:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c4415c26) 00000020:00000080:1.0:1788744494.200454:0:5821:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788744494.200621:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475237504 00000100:00100000:3.0:1788744494.200629:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475237504 00000100:00100000:3.0:1788744494.200659:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744494.200665:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dff54722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1875634475237504:12345-0@lo:250: 00010000:00080000:3.0:1788744494.200688:0:5833:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 754bab6b-7807-4d58-8a45-456ed56af02a@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:3.0:1788744494.200709:0:5833:0:(genops.c:1384:class_connect()) connect: client 754bab6b-7807-4d58-8a45-456ed56af02a, cookie 0x4b162761eb391c37 00000100:00080000:3.0:1788744494.200847:0:5833:0:(import.c:65:import_set_state_nolock()) 000000000e8cd58b : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744494.200928:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dff54722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+5:3306:x1875634475237504:12345-0@lo:250: Request processed in 262us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744494.200936:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788744494.202098:0:5836:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1788744494.202170:0:3306:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788744494.202179:0:3306:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.106@tcp: connect to target with instance 0 00000100:00080000:0.0:1788744494.202187:0:3306:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788744494.202191:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788744494.202194:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000e56d2e36 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788744494.202197:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788744494.202205:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788744494.202210:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080de7bd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:754bab6b-7807-4d58-8a45-456ed56af02a:3306:1875634475237504:0@lo:250: 00000100:00100000:0.0:1788744494.220313:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744494.220560:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788744494.220566:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788744494.234196:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788744494.234213:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788744494.243261:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788744494.243280:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788744494.244399:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744494.244856:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788744494.244872:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788744494.245683:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788744494.245691:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788744494.305476:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744494.305718:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788744494.305743:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788744494.316236:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788744494.316258:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788744494.317648:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744494.317869:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788744494.317877:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788744494.320616:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788744494.320634:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788744494.323154:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744494.323342:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788744494.323349:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788744494.328481:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788744494.328531:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788744494.332511:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744494.332691:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788744494.332696:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788744494.333581:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788744494.333589:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788744494.411428:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744494.411888:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788744494.411903:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788744494.420943:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788744494.420963:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788744494.430126:0:5821:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788744494.430156:0:5821:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788744494.432022:0:5821:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788744494.432050:0:5821:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788744494.432058:0:5821:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788744494.432353:0:5821:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788744494.432394:0:5821:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.106@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788744494.432399:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788744494.432401:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788744494.432402:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744494.432403:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744494.432405:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744494.432406:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744494.432407:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744494.432409:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788744494.432410:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744494.432412:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744494.432413:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744494.432415:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788744494.432417:0:5821:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788744494.432419:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744494.432420:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788744494.432421:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744494.432422:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744494.432423:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744494.432424:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744494.432425:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744494.432426:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788744494.432427:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744494.432427:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744494.432428:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744494.432429:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788744494.432477:0:5821:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788744494.432580:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000089aba16f pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475237632:0@lo:253: 00000100:00100000:2.0:1788744494.432865:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744494.432963:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000004e0f9c8c going to sleep for 11 seconds 00000100:00100000:2.0:1788744494.433111:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475237632 00000100:00100000:2.0:1788744494.433119:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475237632 00000100:00100000:2.0:1788744494.433369:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744494.433383:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000099ba9891 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+5:5821:x1875634475237632:12345-0@lo:253: 20000000:01000000:2.0:1788744494.433432:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788744494.433436:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788744494.434289:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788744494.434348:0:5835:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788744494.434908:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744494.436938:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788744494.437302:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788744494.437307:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788744494.437313:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788744494.437316:0:5835:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788744494.437333:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788744494.437906:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744494.438345:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788744494.438362:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788744494.438420:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788744494.438473:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788744494.438620:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788744494.438949:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788744494.438960:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788744494.439011:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788744494.439020:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788744494.439053:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788744494.439061:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788744494.439091:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788744494.440279:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788744494.440349:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788744494.440355:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788744494.440368:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744494.441404:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788744494.441424:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788744494.441476:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788744494.444341:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788744494.444567:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788744494.444591:0:5835:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788744494.444919:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788744494.444931:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788744494.445444:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788744494.445570:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788744494.445822:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788744494.445840:0:5835:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788744494.445973:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788744494.445985:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788744494.446023:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788744494.446056:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788744494.446363:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788744494.446808:0:5835:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788744494.446818:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788744494.448036:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788744494.449015:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788744494.449045:0:5835:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.106@tcp for mdt 20000000:01000000:3.0:1788744494.449049:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:3.0:1788744494.449088:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788744494.449096:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788744494.449679:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788744494.449692:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:2.0:1788744494.449791:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788744494.449805:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788744494.449838:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788744494.449874:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788744494.449962:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788744494.449965:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788744494.449971:0:5835:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788744494.449977:0:5835:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788744494.451182:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1788744494.451333:0:5835:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788744494.479305:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788744494.479367:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1788744494.479450:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1788744494.479473:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788744494.479475:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788744494.479480:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788744494.479787:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788744494.479791:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788744494.479825:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788744494.479841:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788744494.481263:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788744494.483388:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788744494.483441:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788744494.483478:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788744494.483510:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788744494.483513:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788744494.485787:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1788744494.486833:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1788744494.486884:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1788744494.486959:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:3.0:1788744494.487127:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788744494.487185:0:5835:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1788744494.487193:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788744494.487214:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000afc6e81f/0x4b162761eb391c3e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744494.487231:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000afc6e81f/0x4b162761eb391c3e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744494.487242:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000afc6e81f/0x4b162761eb391c3e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744494.487248:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000afc6e81f/0x4b162761eb391c3e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744494.487254:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000afc6e81f/0x4b162761eb391c3e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744494.487261:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000afc6e81f/0x4b162761eb391c3e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744494.487267:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000afc6e81f already unused, calling callback (00000000f38923e6) 00010000:00010000:3.0:1788744494.487271:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000afc6e81f/0x4b162761eb391c3e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744494.487277:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000afc6e81f/0x4b162761eb391c3e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744494.487311:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000afc6e81f/0x4b162761eb391c3e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744494.487318:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000afc6e81f/0x4b162761eb391c3e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744494.487323:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000afc6e81f/0x4b162761eb391c3e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788744494.487342:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788744494.793305:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000099ba9891 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+5:5821:x1875634475237632:12345-0@lo:253: Request processed in 359915us (360433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744494.793327:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744494.793468:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000089aba16f pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475237632:0@lo:253: 10000000:01000000:3.0:1788744494.793486:0:5821:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788744494.793568:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788744494.793570:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744494.793571:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744494.793572:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788744494.793573:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744494.793574:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744494.793576:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744494.793577:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744494.793579:0:5821:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788744494.793581:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744494.793653:0:5821:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788744494.793674:0:5821:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ad690a5b from lustre-MDT0000 10000000:01000000:3.0:1788744494.793701:0:5821:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788744494.793705:0:5821:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788744494.793709:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93a207434d40 10000000:01000000:3.0:1788744494.793791:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744494.793799:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93a207434d40 from 1 10000000:01000000:3.0:1788744494.793802:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788744494.793864:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 00000000afc6e81f/0x4b162761eb391c45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744494.793887:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 00000000afc6e81f/0x4b162761eb391c45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744494.793896:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 00000000afc6e81f/0x4b162761eb391c45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744494.794045:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000005c6426 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475237760:0@lo:101: 00000100:00100000:3.0:1788744494.794094:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744494.794296:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2ea75f9 going to sleep for 11 seconds 00000100:00100000:0.0:1788744494.794346:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475237760 00000100:00100000:0.0:1788744494.794354:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475237760 00000100:00100000:0.0:1788744494.794459:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744494.794467:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000078113bbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+5:5821:x1875634475237760:12345-0@lo:101: 00010000:00010000:0.0:1788744494.794480:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744494.794571:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000007be25b2/0x4b162761eb391c4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391c45 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744494.794658:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000007be25b2/0x4b162761eb391c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391c45 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744494.794670:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000007be25b2/0x4b162761eb391c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391c45 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744494.794679:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000007be25b2, rc 0) 00000100:00100000:0.0:1788744494.794836:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000078113bbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+6:5821:x1875634475237760:12345-0@lo:101: Request processed in 371us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744494.794844:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744494.795074:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000005c6426 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475237760:0@lo:101: 00010000:00010000:2.0:1788744494.795091:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 00000000afc6e81f/0x4b162761eb391c45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391c4c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744494.795100:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 00000000afc6e81f/0x4b162761eb391c45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391c4c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744494.795207:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1be7fed pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475237888:0@lo:501: 00000100:00100000:2.0:1788744494.795241:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744494.795273:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bd7b5a23 going to sleep for 11 seconds 00000100:00100000:1.0:1788744494.795343:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475237888 00000100:00100000:1.0:1788744494.795349:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475237888 00000100:00100000:1.0:1788744494.795385:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744494.795394:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fb845512 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+6:5821:x1875634475237888:12345-0@lo:501: 00000100:00100000:1.0:1788744494.795811:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fb845512 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+6:5821:x1875634475237888:12345-0@lo:501: Request processed in 418us (568us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788744494.795825:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744494.796168:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1be7fed pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475237888:0@lo:501: 10000000:01000000:2.0:1788744494.796200:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788744494.796212:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 00000000afc6e81f/0x4b162761eb391c45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391c4c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744494.796221:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 00000000afc6e81f/0x4b162761eb391c45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391c4c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744494.796241:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93a203f6f000 10000000:01000000:2.0:1788744494.796245:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788744494.796249:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93a203f6f000 10000000:01000000:2.0:1788744494.796252:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788744494.796254:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93a203f6f000 from 1 10000000:01000000:2.0:1788744494.796257:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788744494.796284:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 000000000de214f0/0x4b162761eb391c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744494.796292:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 000000000de214f0/0x4b162761eb391c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744494.796300:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 000000000de214f0/0x4b162761eb391c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744494.796314:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1be7fed pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475238016:0@lo:101: 00000100:00100000:2.0:1788744494.796344:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744494.796381:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bd7b5a23 going to sleep for 11 seconds 00000100:00100000:3.0:1788744494.796436:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475238016 00000100:00100000:3.0:1788744494.796441:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475238016 00000100:00100000:3.0:1788744494.796478:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744494.796485:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000009edb8f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+6:5821:x1875634475238016:12345-0@lo:101: 00010000:00010000:3.0:1788744494.796505:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744494.796516:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b301a355/0x4b162761eb391c5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391c53 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744494.796533:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b301a355/0x4b162761eb391c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391c53 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744494.796541:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b301a355/0x4b162761eb391c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391c53 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744494.796548:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b301a355, rc 0) 00000100:00100000:3.0:1788744494.796580:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000009edb8f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+7:5821:x1875634475238016:12345-0@lo:101: Request processed in 96us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744494.796786:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744494.796873:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1be7fed pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475238016:0@lo:101: 00010000:00010000:2.0:1788744494.796886:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 000000000de214f0/0x4b162761eb391c53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391c5a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744494.796894:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 000000000de214f0/0x4b162761eb391c53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391c5a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744494.797037:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788744494.797042:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 000000000de214f0/0x4b162761eb391c53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391c5a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744494.797061:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 000000000de214f0/0x4b162761eb391c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391c5a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744494.797069:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788744494.797073:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788744494.797078:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93a203f6f000 10000000:01000000:2.0:1788744494.797081:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788744494.797084:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788744494.797086:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788744494.797105:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 000000009d20e9ef/0x4b162761eb391c61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744494.797111:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 000000009d20e9ef/0x4b162761eb391c61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744494.797118:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 000000009d20e9ef/0x4b162761eb391c61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744494.797219:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1be7fed pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475238144:0@lo:101: 00000100:00100000:3.0:1788744494.797457:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744494.797670:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bd7b5a23 going to sleep for 11 seconds 00000100:00100000:1.0:1788744494.797794:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475238144 00000100:00100000:1.0:1788744494.797802:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475238144 00000100:00100000:1.0:1788744494.797881:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744494.797889:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008debac63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+7:5821:x1875634475238144:12345-0@lo:101: 00010000:00010000:1.0:1788744494.797912:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744494.797924:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001cdfce46/0x4b162761eb391c68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391c61 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744494.797944:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001cdfce46/0x4b162761eb391c68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391c61 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744494.797952:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001cdfce46/0x4b162761eb391c68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391c61 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744494.797960:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001cdfce46, rc 0) 00000100:00100000:1.0:1788744494.798158:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008debac63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+8:5821:x1875634475238144:12345-0@lo:101: Request processed in 270us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744494.798164:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744494.798236:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1be7fed pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475238144:0@lo:101: 00010000:00010000:3.0:1788744494.798251:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 000000009d20e9ef/0x4b162761eb391c61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391c68 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744494.798258:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 000000009d20e9ef/0x4b162761eb391c61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391c68 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744494.798313:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000258d6711 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475238272:0@lo:501: 00000100:00100000:3.0:1788744494.798339:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744494.798610:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a9b2e8d going to sleep for 11 seconds 00000100:00100000:2.0:1788744494.798701:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475238272 00000100:00100000:2.0:1788744494.798707:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475238272 00000100:00100000:2.0:1788744494.798872:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744494.798881:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b95d469b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+8:5821:x1875634475238272:12345-0@lo:501: 00000100:00100000:2.0:1788744494.799196:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b95d469b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+9:5821:x1875634475238272:12345-0@lo:501: Request processed in 316us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744494.799203:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788744494.799348:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000258d6711 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475238272:0@lo:501: 00000100:00100000:3.0:1788744494.799388:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000258d6711 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475238400:0@lo:503: 00000100:00100000:3.0:1788744494.799431:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744494.799464:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a9b2e8d going to sleep for 11 seconds 00000100:00100000:2.0:1788744494.800181:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475238400 00000100:00100000:2.0:1788744494.800197:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475238400 00000100:00100000:2.0:1788744494.800225:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744494.800232:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003e30af3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+9:5821:x1875634475238400:12345-0@lo:503: 00000100:00100000:2.0:1788744494.800418:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003e30af3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+9:5821:x1875634475238400:12345-0@lo:503: Request processed in 186us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744494.800424:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744494.800649:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000258d6711 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475238400:0@lo:503: 00000100:00100000:3.0:1788744494.801413:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000258d6711 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:5863:1875634475238528:0@lo:502: 00000100:00100000:3.0:1788744494.801469:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744494.802079:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set 0000000021d4d66c going to sleep for 11 seconds 00000100:00100000:2.0:1788744494.802165:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475238528 00000100:00100000:2.0:1788744494.802173:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475238528 00000100:00100000:2.0:1788744494.802229:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744494.802240:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008aa6cf34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+9:5863:x1875634475238528:12345-0@lo:502: 00000100:00100000:2.0:1788744494.802815:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008aa6cf34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+9:5863:x1875634475238528:12345-0@lo:502: Request processed in 575us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744494.802823:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744494.802940:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000258d6711 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:5863:1875634475238528:0@lo:502: 00000020:01000000:3.0:1788744494.803119:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744494.803180:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744494.803183:0:5863:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788744494.803190:0:5863:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788744494.803194:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788744494.803210:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005f868080) 00000020:00000080:3.0:1788744494.803236:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788744494.803251:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788744494.803372:0:5863:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788744494.803380:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b162761eb391c76 00000020:00000080:3.0:1788744494.804105:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788744494.804113:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744494.804117:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744494.804119:0:5863:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788744494.804122:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744494.804126:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744494.804154:0:5863:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788744494.804160:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788744494.804169:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000e2d422fd) 00000020:00000080:3.0:1788744494.804182:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788744494.804186:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788744494.804188:0:5863:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788744494.804191:0:5863:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788744494.804198:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788744494.804260:0:5863:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ad690a5b from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788744494.804280:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000865a48a8) 00000020:00000080:3.0:1788744494.804289:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788744494.804340:0:5863:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788744494.804345:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b162761eb391c8b 00000020:00000080:3.0:1788744494.804435:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788744494.804441:0:5863:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788744494.804444:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4b162761eb391c92 00080000:01000000:3.0:1788744494.804449:0:5863:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788744494.804452:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b162761eb391c99 00080000:10000000:3.0:1788744494.806052:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788744494.806327:0:5863:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788744494.810414:0:5863:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788744494.913123:0:5863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788744494.922072:0:5863:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788744494.929328:0:5863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788744494.931218:0:5863:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788744495.026231:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000cfc17a48) 00000020:00000080:0.0:1788744495.026259:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788744495.026538:0:5863:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788744495.026561:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b162761eb391ca7 00000020:00000080:0.0:1788744495.028511:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788744495.045917:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788744495.112332:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744495.176091:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00010000:00010000:2.0:1788744495.223976:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1788744495.243108:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788744495.319663:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744495.421199:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788744495.500505:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4b162761eb391cae 00000020:00000080:0.0:1788744495.501443:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788744495.501460:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744495.501468:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744495.501471:0:5863:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788744495.501484:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744495.501491:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744495.501493:0:5863:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788744495.501498:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788744495.501544:0:5863:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788744495.501563:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744495.501567:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744495.501568:0:5863:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788744495.501570:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744495.501572:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744495.501573:0:5863:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788744495.501577:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788744495.501578:0:5863:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788744495.501796:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000468600fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:5863:1875634475238656:0@lo:502: 00000100:00100000:0.0:1788744495.502042:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744495.502114:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b04256e going to sleep for 11 seconds 00000100:00100000:3.0:1788744495.502218:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475238656 00000100:00100000:3.0:1788744495.502228:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475238656 00000100:00100000:3.0:1788744495.502285:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744495.502303:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004af846f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+9:5863:x1875634475238656:12345-0@lo:502: 00000100:00100000:3.0:1788744495.503172:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004af846f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+9:5863:x1875634475238656:12345-0@lo:502: Request processed in 869us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744495.503185:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744495.503260:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000468600fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:5863:1875634475238656:0@lo:502: 00000020:01000000:3.0:1788744495.503298:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744495.503305:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744495.503307:0:5863:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788744495.503312:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788744495.503445:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788744495.503462:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788744495.503722:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 000000009d20e9ef/0x4b162761eb391c61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391c68 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744495.503737:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 000000009d20e9ef/0x4b162761eb391c61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391c68 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744495.503747:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93a203f6f000 from 1 10000000:01000000:3.0:1788744495.503751:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788744495.503796:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 00000000638044cc/0x4b162761eb391cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744495.503805:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 00000000638044cc/0x4b162761eb391cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744495.503814:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 00000000638044cc/0x4b162761eb391cb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744495.503836:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000258d6711 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475238784:0@lo:101: 00000100:00100000:3.0:1788744495.503884:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744495.504124:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ddb5ff29 going to sleep for 11 seconds 00000100:00100000:0.0:1788744495.504348:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475238784 00000100:00100000:0.0:1788744495.504356:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475238784 00000100:00100000:0.0:1788744495.504403:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744495.504411:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000098b71664 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+9:5821:x1875634475238784:12345-0@lo:101: 00010000:00010000:0.0:1788744495.504430:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744495.504443:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000094e430e4/0x4b162761eb391cbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391cb5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744495.504465:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000094e430e4/0x4b162761eb391cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391cb5 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744495.504486:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000094e430e4/0x4b162761eb391cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391cb5 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744495.504495:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000094e430e4, rc 0) 00000100:00100000:0.0:1788744495.504532:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000098b71664 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+10:5821:x1875634475238784:12345-0@lo:101: Request processed in 122us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744495.504539:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744495.504771:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000258d6711 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475238784:0@lo:101: 00010000:00010000:3.0:1788744495.504784:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 00000000638044cc/0x4b162761eb391cb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391cbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744495.504792:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 00000000638044cc/0x4b162761eb391cb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391cbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744495.505499:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000258d6711 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475238912:0@lo:256: 00000100:00100000:3.0:1788744495.505552:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744495.505583:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ddb5ff29 going to sleep for 11 seconds 00000100:00100000:3.0:1788744495.505879:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475238912 00000100:00100000:3.0:1788744495.506091:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475238912 00000100:00100000:3.0:1788744495.506177:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788744495.506187:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003d3f8a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+10:5821:x1875634475238912:12345-0@lo:256: 20000000:01000000:3.0:1788744495.506206:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788744495.506213:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788744495.506284:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003d3f8a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+10:5821:x1875634475238912:12345-0@lo:256: Request processed in 99us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744495.506290:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788744495.506426:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000258d6711 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475238912:0@lo:256: 10000000:01000000:2.0:1788744495.507317:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788744495.507350:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 00000000638044cc/0x4b162761eb391cb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391cbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744495.507362:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 00000000638044cc/0x4b162761eb391cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391cbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744495.507370:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a203f6f000 from 1 10000000:01000000:2.0:1788744495.507383:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744495.507417:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 00000000386b6226/0x4b162761eb391cc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744495.507424:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 00000000386b6226/0x4b162761eb391cc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744495.507434:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 00000000386b6226/0x4b162761eb391cc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744495.507451:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049226166 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475239040:0@lo:101: 00000100:00100000:2.0:1788744495.507577:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744495.507692:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4777abb going to sleep for 11 seconds 00000100:00100000:3.0:1788744495.508672:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475239040 00000100:00100000:3.0:1788744495.508683:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475239040 00000100:00100000:3.0:1788744495.508797:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788744495.508807:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003807568b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+10:5821:x1875634475239040:12345-0@lo:101: 00010000:00010000:3.0:1788744495.508823:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744495.508840:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bbf6bb80/0x4b162761eb391cca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391cc3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744495.508882:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bbf6bb80/0x4b162761eb391cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391cc3 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744495.509079:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bbf6bb80/0x4b162761eb391cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391cc3 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744495.509089:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bbf6bb80, rc 0) 00000100:00100000:3.0:1788744495.509179:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003807568b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+11:5821:x1875634475239040:12345-0@lo:101: Request processed in 374us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744495.509185:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788744495.509352:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049226166 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475239040:0@lo:101: 00010000:00010000:2.0:1788744495.509368:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 00000000386b6226/0x4b162761eb391cc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391cca expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744495.509376:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 00000000386b6226/0x4b162761eb391cc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391cca expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744495.509879:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049226166 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475239168:0@lo:501: 00000100:00100000:2.0:1788744495.510056:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744495.510183:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4777abb going to sleep for 11 seconds 00000100:00100000:0.0:1788744495.510471:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475239168 00000100:00100000:0.0:1788744495.510540:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475239168 00000100:00100000:0.0:1788744495.510670:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788744495.510679:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e9efba34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:5821:x1875634475239168:12345-0@lo:501: 00000100:00100000:0.0:1788744495.512122:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e9efba34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:5821:x1875634475239168:12345-0@lo:501: Request processed in 1441us (2063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744495.512152:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744495.512671:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049226166 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475239168:0@lo:501: 00000100:00100000:2.0:1788744495.512799:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049226166 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475239296:0@lo:503: 00000100:00100000:2.0:1788744495.512859:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744495.513052:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4777abb going to sleep for 11 seconds 00000100:00100000:3.0:1788744495.513106:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475239296 00000100:00100000:3.0:1788744495.513113:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475239296 00000100:00100000:3.0:1788744495.513409:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744495.513419:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002820c761 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+11:5821:x1875634475239296:12345-0@lo:503: 00000040:00080000:3.0:1788744495.513470:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788744495.513529:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002820c761 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+11:5821:x1875634475239296:12345-0@lo:503: Request processed in 112us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744495.513536:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788744495.513628:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049226166 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475239296:0@lo:503: 00000040:00080000:2.0:1788744495.515862:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788744495.516419:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788744495.516442:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788744495.516571:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 00000000386b6226/0x4b162761eb391cc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391cca expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744495.516585:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 00000000386b6226/0x4b162761eb391cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391cca expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744495.516723:0:5821:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788744495.516727:0:5821:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93a203f6f000 10000000:01000000:3.0:1788744495.516744:0:5821:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93a203f6f000 10000000:01000000:3.0:1788744495.516750:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744495.516758:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93a203f6f000 from 1 10000000:01000000:3.0:1788744495.516760:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788744495.516801:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 00000000fc879c59/0x4b162761eb391cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744495.516809:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 00000000fc879c59/0x4b162761eb391cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744495.516822:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 00000000fc879c59/0x4b162761eb391cd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744495.516850:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e60b859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475239424:0@lo:101: 00000100:00100000:3.0:1788744495.517119:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744495.517265:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ddb5ff29 going to sleep for 11 seconds 00000100:00100000:2.0:1788744495.517453:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475239424 00000100:00100000:2.0:1788744495.517461:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475239424 00000100:00100000:2.0:1788744495.517709:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744495.517720:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a2703c07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:5821:x1875634475239424:12345-0@lo:101: 00010000:00010000:2.0:1788744495.517735:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744495.517752:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004682860c/0x4b162761eb391cd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391cd1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744495.517778:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004682860c/0x4b162761eb391cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391cd1 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744495.517787:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004682860c/0x4b162761eb391cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391cd1 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744495.517795:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004682860c, rc 0) 00000100:00100000:2.0:1788744495.517853:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a2703c07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+12:5821:x1875634475239424:12345-0@lo:101: Request processed in 136us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744495.517859:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788744495.517939:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e60b859 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475239424:0@lo:101: 00010000:00010000:0.0:1788744495.517966:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 00000000fc879c59/0x4b162761eb391cd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391cd8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744495.517976:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 00000000fc879c59/0x4b162761eb391cd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391cd8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744495.518062:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000abe56dfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475239552:0@lo:501: 00000100:00100000:0.0:1788744495.518096:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744495.518739:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c6631ef going to sleep for 11 seconds 00000100:00100000:3.0:1788744495.518848:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475239552 00000100:00100000:3.0:1788744495.518854:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475239552 00000100:00100000:3.0:1788744495.518884:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744495.518898:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ac4061a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:5821:x1875634475239552:12345-0@lo:501: 00000100:00100000:3.0:1788744495.519213:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ac4061a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:5821:x1875634475239552:12345-0@lo:501: Request processed in 315us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744495.519220:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744495.519257:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000abe56dfb pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475239552:0@lo:501: 00000100:00100000:3.0:1788744495.519294:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d40162c pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475239680:0@lo:503: 00000100:00100000:3.0:1788744495.519333:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744495.519354:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bd7b5a23 going to sleep for 11 seconds 00000100:00100000:3.0:1788744495.519367:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475239680 00000100:00100000:3.0:1788744495.519377:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475239680 00000100:00100000:3.0:1788744495.519396:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788744495.519401:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005fbb8c13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:5821:x1875634475239680:12345-0@lo:503: 00000100:00100000:3.0:1788744495.519965:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005fbb8c13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:5821:x1875634475239680:12345-0@lo:503: Request processed in 561us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744495.519974:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788744495.520026:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d40162c pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475239680:0@lo:503: 00000100:00100000:0.0:1788744495.520803:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001814db0f pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:5868:1875634475239808:0@lo:502: 00000100:00100000:0.0:1788744495.520860:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744495.520905:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 0000000009d68dd5 going to sleep for 11 seconds 00000100:00100000:3.0:1788744495.521073:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475239808 00000100:00100000:3.0:1788744495.521080:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475239808 00000100:00100000:3.0:1788744495.521125:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788744495.521168:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000031b1dc97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:5868:x1875634475239808:12345-0@lo:502: 00000100:00100000:3.0:1788744495.521429:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000031b1dc97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:5868:x1875634475239808:12345-0@lo:502: Request processed in 263us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744495.521438:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788744495.522337:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001814db0f pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:5868:1875634475239808:0@lo:502: 00000020:01000004:0.0:1788744495.522413:0:5868:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788744495.522429:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d7b4d138) 00000020:00000080:0.0:1788744495.522451:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788744495.522570:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ad690a5b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788744495.522574:0:5868:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ad690a5b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788744495.522577:0:5868:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ad690a5b 4 00010000:00080000:0.0:1788744495.522629:0:5868:0:(ldlm_lib.c:103:import_set_conn()) imp 0000000079f077a6@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:0.0:1788744495.524396:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788744495.524632:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788744495.524667:0:5868:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788744495.524680:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4b162761eb391ce6 00000100:00080000:0.0:1788744495.524690:0:5868:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788744495.524714:0:5868:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000079f077a6 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788744495.524750:0:5868:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001814db0f x1875634475239936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744495.524792:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001814db0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875634475239936:0@lo:38: 00000100:00100000:0.0:1788744495.524859:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744495.524940:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475239936 00000100:00100000:0.0:1788744495.524955:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475239936 00000100:00100000:0.0:1788744495.524992:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744495.524998:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005541f17d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875634475239936:12345-0@lo:38: 00000100:00100000:0.0:1788744495.525055:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005541f17d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875634475239936:12345-0@lo:38: Request processed in 56us (196us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788744495.525062:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744495.525101:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744495.525109:0:3306:0:(import.c:65:import_set_state_nolock()) 0000000079f077a6 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744495.525123:0:3306:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788744495.525127:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001814db0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875634475239936:0@lo:38: 00000100:00080000:0.0:1788744495.525189:0:5868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788744495.542252:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001814db0f pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:5868:1875634475240064:0@lo:502: 00000100:00100000:0.0:1788744495.542345:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744495.542391:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d8f25c7 going to sleep for 11 seconds 00000100:00100000:3.0:1788744495.543751:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475240064 00000100:00100000:3.0:1788744495.543775:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475240064 00000100:00100000:3.0:1788744495.543837:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788744495.543848:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009bd2e3ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:5868:x1875634475240064:12345-0@lo:502: 00000100:00100000:3.0:1788744495.544354:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009bd2e3ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:5868:x1875634475240064:12345-0@lo:502: Request processed in 507us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744495.544361:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788744495.544422:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001814db0f pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:5868:1875634475240064:0@lo:502: 00000040:00080000:3.0:1788744495.544457:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788744495.549422:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788744495.549459:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788744495.549486:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 00000000fc879c59/0x4b162761eb391cd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391cd8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744495.549500:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 00000000fc879c59/0x4b162761eb391cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391cd8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788744495.549797:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788744495.549800:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744495.549801:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744495.549803:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744495.549807:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744495.549809:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744495.549810:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744495.549811:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744495.549813:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788744495.549814:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788744495.549815:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744495.549816:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788744495.549819:0:5821:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788744495.549822:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788744495.549823:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744495.549824:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744495.549825:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744495.549826:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744495.549826:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744495.549827:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744495.549828:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744495.549829:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788744495.549830:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788744495.549831:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744495.549831:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788744495.549855:0:5821:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788744495.549871:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d40162c pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475240192:0@lo:253: 00000100:00100000:3.0:1788744495.549943:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744495.550093:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c9f60e34 going to sleep for 11 seconds 00000100:00100000:1.0:1788744495.550157:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475240192 00000100:00100000:1.0:1788744495.550166:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475240192 00000100:00100000:1.0:1788744495.550204:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788744495.550211:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ba7114b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:5821:x1875634475240192:12345-0@lo:253: 20000000:01000000:1.0:1788744495.550235:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788744495.550247:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788744495.610345:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788744495.610399:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788744495.610490:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788744495.610495:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788744495.610530:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000037cea56e/0x4b162761eb391ced lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744495.610548:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000094e430e4/0x4b162761eb391cbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391cb5 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744495.610556:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000037cea56e/0x4b162761eb391ced lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744495.610794:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000094e430e4/0x4b162761eb391cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391cb5 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744495.610812:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000094e430e4/0x4b162761eb391cbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391cb5 expref: 12 pid: 5834 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744495.610826:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049226166 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875634475240320:0@lo:104: 00000100:00100000:2.0:1788744495.611017:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744495.611081:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set 000000003eceb68e going to sleep for 11 seconds 00000100:00100000:1.0:1788744495.611161:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475240320 00000100:00100000:1.0:1788744495.611171:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475240320 00000100:00100000:1.0:1788744495.611222:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744495.611229:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000a6aefd2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+3:5856:x1875634475240320:12345-0@lo:104: 00010000:00010000:1.0:1788744495.611242:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: 00000000638044cc/0x4b162761eb391cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391cbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.611298:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788744495.611303:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000a6aefd2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+3:5856:x1875634475240320:12345-0@lo:104: Request processed in 75us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744495.611309:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744495.611346:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049226166 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875634475240320:0@lo:104: 00010000:00010000:1.0:1788744495.611363:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000037cea56e/0x4b162761eb391ced lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.611378:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744495.611382:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: 00000000638044cc/0x4b162761eb391cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391cbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.611389:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000638044cc already unused, calling callback (0000000034061b34) 10000000:00010000:1.0:1788744495.611393:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: 00000000638044cc/0x4b162761eb391cb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391cbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.611399:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: 00000000638044cc/0x4b162761eb391cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391cbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744495.611406:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: 00000000638044cc/0x4b162761eb391cb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391cbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744495.611424:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744495.611449:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: 00000000638044cc/0x4b162761eb391cb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391cbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.611456:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744495.611470:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: 00000000638044cc/0x4b162761eb391cb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391cbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.611487:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: 00000000638044cc/0x4b162761eb391cb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391cbc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.611504:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744495.611506:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744495.611507:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744495.611560:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049f20efd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475240448:0@lo:103: 00000100:00100000:1.0:1788744495.611754:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744495.611818:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475240448 00000100:00100000:1.0:1788744495.611822:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475240448 00010000:00010000:1.0:1788744495.611836:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000094e430e4/0x4b162761eb391cbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391cb5 expref: 13 pid: 5834 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744495.611856:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744495.611860:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007a295899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+13:3308:x1875634475240448:12345-0@lo:103: 00010000:00010000:1.0:1788744495.611869:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744495.611872:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000094e430e4/0x4b162761eb391cbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391cb5 expref: 13 pid: 5834 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.611881:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000094e430e4/0x4b162761eb391cbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391cb5 expref: 13 pid: 5834 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.612019:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000094e430e4/0x4b162761eb391cbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391cb5 expref: 13 pid: 5834 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.612031:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000037cea56e/0x4b162761eb391ced lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.612038:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000037cea56e/0x4b162761eb391ced lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788744495.612052:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001557290s 00010000:00010000:1.0:1788744495.612055:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000037cea56e/0x4b162761eb391ced lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.612061:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000037cea56e/0x4b162761eb391ced lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.612068:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000037cea56e/0x4b162761eb391ced lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.612073:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000037cea56e/0x4b162761eb391ced lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.612077:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000037cea56e already unused, calling callback (00000000f38923e6) 00010000:00010000:1.0:1788744495.612080:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000037cea56e/0x4b162761eb391ced lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.612086:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000037cea56e/0x4b162761eb391ced lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.612097:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000037cea56e/0x4b162761eb391ced lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.612114:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744495.612195:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007a295899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+12:3308:x1875634475240448:12345-0@lo:103: Request processed in 335us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744495.612202:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788744495.612223:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000037cea56e/0x4b162761eb391ced lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.612229:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000037cea56e/0x4b162761eb391ced lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744495.612235:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000037cea56e/0x4b162761eb391ced lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744495.612258:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049f20efd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475240448:0@lo:103: 00000100:00100000:3.0:1788744495.626213:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ba7114b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+11:5821:x1875634475240192:12345-0@lo:253: Request processed in 75993us (76261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744495.626230:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788744495.626339:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d40162c pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:5821:1875634475240192:0@lo:253: 10000000:01000000:1.0:1788744495.626355:0:5821:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788744495.626358:0:5821:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788744495.626360:0:5821:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788744495.626361:0:5821:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744495.626362:0:5821:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744495.626364:0:5821:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744495.626365:0:5821:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744495.626366:0:5821:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788744495.626368:0:5821:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788744495.626369:0:5821:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788744495.626370:0:5821:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788744495.626372:0:5821:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744495.626373:0:5821:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788744495.626388:0:5821:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788744495.635418:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788744495.637034:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788744495.637775:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788744495.638197:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788744495.638780:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744495.639735:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744495.641763:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744495.642213:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744495.642774:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744495.643585:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744495.644221:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744495.644735:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788744495.725347:0:5821:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788744495.774541:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788744495.775267:0:5874:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1788744495.778605:0:5873:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788744495.778614:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788744495.782460:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788744495.784078:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788744495.785125:0:5821:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788744495.785165:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788744495.785362:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744495.790355:0:5821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788744495.792928:0:5821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788744495.796278:0:5821:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788744495.798433:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788744495.804318:0:5821:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788744495.805833:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788744495.805992:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788744495.806169:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788744495.806339:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788744495.809305:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788744495.810036:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788744495.810238:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788744495.810405:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788744495.810856:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788744495.811430:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788744495.811766:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788744495.812304:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788744495.812456:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788744495.812863:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788744495.813119:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788744495.813709:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788744495.815413:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788744495.815744:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788744495.816057:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788744495.816276:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788744495.816412:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788744495.816808:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788744495.818471:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788744495.819338:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788744495.821115:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788744495.822162:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788744495.822335:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788744495.822844:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788744495.823012:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788744495.823216:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788744495.823350:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788744495.823540:0:5821:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788744495.824259:0:5821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788744495.859768:0:5874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788744495.937277:0:5821:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788744495.937321:0:5821:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa3c581c33988 00100000:10000000:2.0:1788744495.937330:0:5821:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788744495.938441:0:5821:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788744495.938459:0:5821:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788744495.938548:0:5821:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788744495.938566:0:5821:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788744495.947992:0:5874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788744495.948073:0:5874:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788744495.948078:0:5874:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788744496.244357:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744497.272104:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744498.301230:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744499.321819:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744500.343414:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788744500.532693:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788744500.532704:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788744500.532707:0:36:0:(import.c:65:import_set_state_nolock()) 0000000079f077a6 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744500.532726:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000079f077a6 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788744500.532749:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e34f5bbc x1875634475240704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744500.532786:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e34f5bbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875634475240704:0@lo:38: 00000100:00100000:0.0:1788744500.532860:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744500.533125:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744500.533229:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000674bc698 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475240576:0@lo:400: 00000100:00100000:1.0:1788744500.533268:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744500.533343:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475240704 00000100:00100000:1.0:1788744500.533355:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475240704 00000100:00100000:1.0:1788744500.533444:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744500.533453:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f467693 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875634475240704:12345-0@lo:38: 00010000:00080000:1.0:1788744500.533486:0:5842:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:1.0:1788744500.533531:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4b162761eb391cf4 00000004:00100000:1.0:1788744500.533582:0:5842:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788744500.533713:0:5842:0:(import.c:65:import_set_state_nolock()) 00000000402ff1c6 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744500.533772:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f467693 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875634475240704:12345-0@lo:38: Request processed in 319us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744500.533779:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788744500.533846:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e34f5bbc x1875634475240704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788744500.533875:0:3306:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788744500.533885:0:3306:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788744500.533890:0:3306:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788744500.533892:0:3306:0:(import.c:65:import_set_state_nolock()) 0000000079f077a6 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788744500.533897:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e34f5bbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875634475240704:0@lo:38: 00000100:00100000:0.0:1788744500.535251:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475240576 00000100:00100000:0.0:1788744500.535265:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475240576 00000100:00100000:0.0:1788744500.535321:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788744500.535330:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cb268f19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:3310:x1875634475240576:12345-0@lo:400: 00000100:00100000:0.0:1788744500.535408:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cb268f19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:3310:x1875634475240576:12345-0@lo:400: Request processed in 79us (2140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744500.535415:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788744500.536373:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000674bc698 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475240576:0@lo:400: 00010000:00010000:0.0:1788744501.384489:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788744501.740714:0:6117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788744502.390403:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788744502.588245:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788744502.588251:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93a203f6f000 from 3 10000000:01000000:2.0:1788744502.588255:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788744502.588295:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 00000000ecf951b7/0x4b162761eb391cfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744502.588319:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 00000000ecf951b7/0x4b162761eb391cfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744502.588337:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 00000000ecf951b7/0x4b162761eb391cfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744502.588368:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ae87ab8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475240832:0@lo:101: 00000100:00100000:2.0:1788744502.588435:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744502.588483:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set 0000000045be8b6d going to sleep for 11 seconds 00000100:00100000:3.0:1788744502.588558:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475240832 00000100:00100000:3.0:1788744502.588574:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475240832 00000100:00100000:3.0:1788744502.588644:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788744502.588653:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001f347587 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+11:5837:x1875634475240832:12345-0@lo:101: 00010000:00010000:3.0:1788744502.588933:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744502.588948:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c0c7837e/0x4b162761eb391d02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391cfb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744502.588973:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0c7837e/0x4b162761eb391d02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391cfb expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744502.588983:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c0c7837e/0x4b162761eb391d02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391cfb expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744502.588992:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c0c7837e, rc 0) 00000100:00100000:3.0:1788744502.589048:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001f347587 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:5837:x1875634475240832:12345-0@lo:101: Request processed in 396us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744502.589055:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744502.589098:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ae87ab8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475240832:0@lo:101: 00010000:00010000:1.0:1788744502.589111:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 00000000ecf951b7/0x4b162761eb391cfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d02 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744502.589120:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 00000000ecf951b7/0x4b162761eb391cfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391d02 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744502.589190:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049f20efd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475240960:0@lo:256: 00000100:00100000:1.0:1788744502.589221:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744502.589243:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set 0000000027b9d133 going to sleep for 11 seconds 00000100:00100000:1.0:1788744502.589256:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475240960 00000100:00100000:1.0:1788744502.589259:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475240960 00000100:00100000:1.0:1788744502.589285:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788744502.589292:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a908b222 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:5837:x1875634475240960:12345-0@lo:256: 20000000:01000000:1.0:1788744502.589319:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788744502.589336:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788744502.589339:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788744502.589430:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a908b222 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:5837:x1875634475240960:12345-0@lo:256: Request processed in 139us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744502.589436:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788744502.593233:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049f20efd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475240960:0@lo:256: 10000000:01000000:3.0:1788744502.593306:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788744502.593314:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 00000000ecf951b7/0x4b162761eb391cfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d02 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744502.593326:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 00000000ecf951b7/0x4b162761eb391cfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d02 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744503.413438:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744504.437051:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744505.462316:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744505.652351:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744505.652462:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744505.652494:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007cfad36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475241216:0@lo:400: 00000100:00100000:1.0:1788744505.652569:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744505.652733:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475241216 00000100:00100000:3.0:1788744505.652743:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475241216 00000100:00100000:0.0:1788744505.652792:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af47e484 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475241088:0@lo:400: 00000100:00100000:3.0:1788744505.652796:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744505.652806:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d5afc2b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475241216:12345-0@lo:400: 00000100:00100000:0.0:1788744505.652835:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744505.652875:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d5afc2b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475241216:12345-0@lo:400: Request processed in 70us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744505.652883:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744505.652906:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475241088 00000100:00100000:3.0:1788744505.652909:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475241088 00000100:00100000:3.0:1788744505.652938:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788744505.652944:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c55346c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:3309:x1875634475241088:12345-0@lo:400: 00000100:00100000:3.0:1788744505.652977:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c55346c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:3309:x1875634475241088:12345-0@lo:400: Request processed in 33us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744505.652983:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788744505.653017:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af47e484 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475241088:0@lo:400: 00010000:00080000:1.0:1788744505.657553:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000007cfad36 x1875634475241216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744505.657572:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007cfad36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475241216:0@lo:400: 00010000:00010000:0.0:1788744506.485164:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788744507.051704:0:6320:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb2f9e170 20000000:00000080:3.0:1788744507.051724:0:6320:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93a239450400 uarg=0000000000000000 20000000:01000000:3.0:1788744507.053017:0:6320:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788744507.053027:0:6320:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788744507.053032:0:6320:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788744507.054615:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788744507.054631:0:6320:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788744507.059952:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744507.060457:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788744507.060528:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788744507.060581:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788744507.060607:0:6320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788744507.060624:0:6320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000b9507f9/0x4b162761eb391d09 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744507.060643:0:6320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bbf6bb80/0x4b162761eb391cca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391cc3 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744507.060652:0:6320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000b9507f9/0x4b162761eb391d09 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744507.060690:0:6320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bbf6bb80/0x4b162761eb391cca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391cc3 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744507.060707:0:6320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bbf6bb80/0x4b162761eb391cca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391cc3 expref: 11 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744507.060720:0:6320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077dcbe0f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1875634475241344:0@lo:104: 00000100:00100000:0.0:1788744507.060793:0:6320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744507.061299:0:6320:0:(client.c:2716:ptlrpc_set_wait()) set 0000000015b46a08 going to sleep for 11 seconds 00000100:00100000:2.0:1788744507.061848:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475241344 00000100:00100000:2.0:1788744507.061857:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475241344 00000100:00100000:2.0:1788744507.061904:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744507.061912:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008bdeaa42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+3:6320:x1875634475241344:12345-0@lo:104: 00010000:00010000:2.0:1788744507.061926:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: 00000000386b6226/0x4b162761eb391cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391cca expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744507.062745:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744507.062761:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008bdeaa42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+3:6320:x1875634475241344:12345-0@lo:104: Request processed in 849us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744507.062771:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788744507.062913:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744507.062919:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: 00000000386b6226/0x4b162761eb391cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391cca expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744507.062928:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000386b6226 already unused, calling callback (0000000034061b34) 10000000:00010000:1.0:1788744507.062931:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: 00000000386b6226/0x4b162761eb391cc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391cca expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744507.062938:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: 00000000386b6226/0x4b162761eb391cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391cca expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744507.062944:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: 00000000386b6226/0x4b162761eb391cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391cca expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744507.062950:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744507.063004:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: 00000000386b6226/0x4b162761eb391cc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391cca expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744507.063011:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744507.063038:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: 00000000386b6226/0x4b162761eb391cc3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391cca expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744507.063044:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: 00000000386b6226/0x4b162761eb391cc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391cca expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744507.063066:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744507.063078:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744507.063088:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744507.063258:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744507.063273:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007cfad36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475241472:0@lo:103: 00000100:00100000:3.0:1788744507.063322:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744507.063577:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475241472 00000100:00100000:1.0:1788744507.063585:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475241472 00010000:00010000:1.0:1788744507.063609:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bbf6bb80/0x4b162761eb391cca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391cc3 expref: 12 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744507.063640:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744507.063648:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a6ac664a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+12:3307:x1875634475241472:12345-0@lo:103: 00010000:00010000:1.0:1788744507.063660:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744507.063664:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bbf6bb80/0x4b162761eb391cca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391cc3 expref: 12 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744507.063673:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bbf6bb80/0x4b162761eb391cca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391cc3 expref: 12 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744507.063691:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000b9507f9/0x4b162761eb391d09 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744507.063698:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b9507f9/0x4b162761eb391d09 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744507.063712:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000b9507f9/0x4b162761eb391d09 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744507.063719:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000b9507f9/0x4b162761eb391d09 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744507.063725:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000b9507f9/0x4b162761eb391d09 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744507.063731:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000b9507f9/0x4b162761eb391d09 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744507.063748:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000b9507f9 already unused, calling callback (00000000f38923e6) 00010000:00010000:1.0:1788744507.063764:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000b9507f9/0x4b162761eb391d09 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744507.063772:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000b9507f9/0x4b162761eb391d09 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744507.063780:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000b9507f9/0x4b162761eb391d09 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744507.063790:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744507.063833:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a6ac664a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+12:3307:x1875634475241472:12345-0@lo:103: Request processed in 187us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744507.063840:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744507.063907:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007cfad36 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475241472:0@lo:103: 00010000:00010000:0.0:1788744507.064977:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bbf6bb80/0x4b162761eb391cca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391cc3 expref: 11 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744507.065004:0:6320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077dcbe0f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1875634475241344:0@lo:104: 00010000:00010000:0.0:1788744507.065022:0:6320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000b9507f9/0x4b162761eb391d09 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744507.065030:0:6320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000b9507f9/0x4b162761eb391d09 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744507.065036:0:6320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000b9507f9/0x4b162761eb391d09 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744507.065059:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000b9507f9/0x4b162761eb391d09 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744507.508766:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744508.534703:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744509.557338:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788744509.750186:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788744509.750194:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a203f6f000 from 1 10000000:01000000:3.0:1788744509.750199:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788744509.750241:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 0000000014b61f67/0x4b162761eb391d10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744509.750263:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 0000000014b61f67/0x4b162761eb391d10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744509.750274:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 0000000014b61f67/0x4b162761eb391d10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744509.750297:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba92dc2e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475241600:0@lo:101: 00000100:00100000:3.0:1788744509.750364:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744509.750414:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c8f7c19a going to sleep for 11 seconds 00000100:00100000:0.0:1788744509.750778:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475241600 00000100:00100000:0.0:1788744509.750786:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475241600 00000100:00100000:0.0:1788744509.751666:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788744509.751680:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008579f259 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:5837:x1875634475241600:12345-0@lo:101: 00010000:00010000:0.0:1788744509.751697:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744509.751714:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000080c0ef29/0x4b162761eb391d17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391d10 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744509.751740:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080c0ef29/0x4b162761eb391d17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391d10 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744509.751749:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000080c0ef29/0x4b162761eb391d17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391d10 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744509.751759:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000080c0ef29, rc 0) 00000100:00100000:0.0:1788744509.751819:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008579f259 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+12:5837:x1875634475241600:12345-0@lo:101: Request processed in 144us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744509.751825:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744509.753235:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba92dc2e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475241600:0@lo:101: 00010000:00010000:1.0:1788744509.753260:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 0000000014b61f67/0x4b162761eb391d10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d17 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744509.753271:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 0000000014b61f67/0x4b162761eb391d10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391d17 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744509.753350:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007026f335 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475241728:0@lo:501: 00000100:00100000:1.0:1788744509.753398:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744509.756225:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc73b30d going to sleep for 11 seconds 00000100:00100000:3.0:1788744509.759210:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475241728 00000100:00100000:3.0:1788744509.759223:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475241728 00000100:00100000:3.0:1788744509.759282:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744509.759291:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a54d5c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:5837:x1875634475241728:12345-0@lo:501: 00000100:00100000:3.0:1788744509.759593:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a54d5c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:5837:x1875634475241728:12345-0@lo:501: Request processed in 303us (6194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744509.759600:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744509.759645:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007026f335 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475241728:0@lo:501: 00000100:00100000:3.0:1788744509.759698:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018524c6e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475241856:0@lo:503: 00000100:00100000:3.0:1788744509.759764:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744509.759790:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set 00000000365bc652 going to sleep for 11 seconds 00000100:00100000:3.0:1788744509.759809:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475241856 00000100:00100000:3.0:1788744509.759814:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475241856 00000100:00100000:3.0:1788744509.759829:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788744509.759835:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a4a47159 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:5837:x1875634475241856:12345-0@lo:503: 00000100:00100000:3.0:1788744509.759969:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a4a47159 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:5837:x1875634475241856:12345-0@lo:503: Request processed in 135us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744509.759986:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788744509.760015:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018524c6e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475241856:0@lo:503: 00000100:00100000:3.0:1788744509.760226:0:6437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018524c6e pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:6437:1875634475241984:0@lo:502: 00000100:00100000:3.0:1788744509.760258:0:6437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744509.760277:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475241984 00000100:00100000:3.0:1788744509.760281:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475241984 00000100:00100000:3.0:1788744509.760298:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744509.760303:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005db32f19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:6437:x1875634475241984:12345-0@lo:502: 00000100:00100000:3.0:1788744509.760399:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005db32f19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:6437:x1875634475241984:12345-0@lo:502: Request processed in 96us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744509.760405:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744509.760431:0:6437:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c5e830ee going to sleep for 11 seconds 00000100:00100000:3.0:1788744509.760443:0:6437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018524c6e pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:6437:1875634475241984:0@lo:502: 00000020:01000000:3.0:1788744509.760475:0:6437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744509.760485:0:6437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744509.760486:0:6437:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788744509.760492:0:6437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93a203f6f000 00000020:00000080:3.0:1788744509.760494:0:6437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788744509.760529:0:6437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d637100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:6437:1875634475242112:0@lo:502: 00000100:00100000:3.0:1788744509.760559:0:6437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744509.760577:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475242112 00000100:00100000:3.0:1788744509.760581:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475242112 00000100:00100000:3.0:1788744509.760597:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788744509.760603:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:6437:x1875634475242112:12345-0@lo:502: 00000100:00100000:3.0:1788744509.760687:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:6437:x1875634475242112:12345-0@lo:502: Request processed in 84us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744509.760702:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788744509.760727:0:6437:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744509.760738:0:6437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d637100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:6437:1875634475242112:0@lo:502: 00000020:01000000:3.0:1788744509.760755:0:6437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744509.760759:0:6437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744509.760760:0:6437:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788744509.760763:0:6437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788744509.760805:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788744509.760824:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788744509.760836:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a238531e00/0x4b162761eb391d10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d17 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744509.760846:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a238531e00/0x4b162761eb391d10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d17 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744510.581470:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744510.774381:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475242240:0@lo:400: 00000100:00100000:3.0:1788744510.774461:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744510.774525:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744510.774532:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475242368:0@lo:400: 00000100:00100000:3.0:1788744510.774560:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744510.774594:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475242240 00000100:00100000:3.0:1788744510.774601:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475242240 00000100:00100000:2.0:1788744510.781407:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475242368 00000100:00100000:2.0:1788744510.781423:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475242368 00000100:00100000:2.0:1788744510.781494:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744510.781505:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475242368:12345-0@lo:400: 00000100:00100000:2.0:1788744510.781610:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475242368:12345-0@lo:400: Request processed in 107us (7047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744510.781617:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788744510.781686:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93a23d636680 x1875634475242368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744510.781703:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475242368:0@lo:400: 00000100:00100000:3.0:1788744510.789303:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788744510.789325:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:3309:x1875634475242240:12345-0@lo:400: 00000100:00100000:3.0:1788744510.789453:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:3309:x1875634475242240:12345-0@lo:400: Request processed in 136us (14991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744510.789460:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788744510.789904:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475242240:0@lo:400: 00010000:00010000:1.0:1788744511.604750:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744512.630931:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744513.652766:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788744514.232931:0:6680:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788744514.232934:0:6680:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788744514.233069:0:6680:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93a210e7e800 00000020:01000004:3.0:1788744514.233087:0:6680:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788744514.233100:0:6680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788744514.233113:0:6680:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93a23d66cd40) 00000020:00000080:3.0:1788744514.233151:0:6680:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788744514.245449:0:6680:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788744514.245679:0:6680:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788744514.290798:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788744514.305580:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788744514.305618:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788744514.306364:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788744514.306411:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788744514.307579:0:6680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788744514.307592:0:6680:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788744514.307607:0:6680:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b162761eb391d25 00000020:01000004:2.0:1788744514.307615:0:6680:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788744514.307662:0:6680:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788744514.307666:0:6680:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788744514.307675:0:6680:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788744514.307680:0:6680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788744514.307709:0:6680:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93a23c698000) 00000020:00000080:2.0:1788744514.307722:0:6680:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788744514.313789:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744514.314205:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788744514.314213:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788744514.320105:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788744514.320120:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788744514.323248:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788744514.323261:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788744514.329934:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744514.331268:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788744514.331284:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788744514.335342:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788744514.335357:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788744514.383413:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744514.383714:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788744514.383722:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788744514.389273:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788744514.389291:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788744514.390939:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788744514.391079:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788744514.398896:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744514.399319:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788744514.399326:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788744514.400735:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788744514.400753:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788744514.468820:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744514.469124:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788744514.469165:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788744514.470545:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788744514.470565:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788744514.471298:0:6680:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788744514.471325:0:6680:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788744514.471334:0:6680:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788744514.523972:0:6680:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788744514.524328:0:6680:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.106@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788744514.524332:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788744514.524334:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788744514.524336:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744514.524337:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744514.524338:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744514.524340:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744514.524342:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744514.524343:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744514.524345:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744514.524347:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744514.524348:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788744514.524352:0:6680:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788744514.524354:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744514.524356:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788744514.524357:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744514.524358:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744514.524359:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744514.524366:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744514.524500:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744514.524502:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744514.524503:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744514.524503:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744514.524504:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788744514.524531:0:6680:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788744514.524553:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475242496:0@lo:253: 00000100:00100000:2.0:1788744514.524743:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744514.524852:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20d4e3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788744514.524926:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475242496 00000100:00100000:1.0:1788744514.524934:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475242496 00000100:00100000:1.0:1788744514.525718:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788744514.525735:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:6680:x1875634475242496:12345-0@lo:253: 20000000:01000000:1.0:1788744514.525789:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788744514.525793:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788744514.525798:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788744514.525802:0:5835:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788744514.528704:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744514.528937:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788744514.528951:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788744514.528990:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788744514.528999:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788744514.529044:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788744514.529093:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788744514.529516:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788744514.529536:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.106@tcp 20000000:01000000:1.0:1788744514.529538:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:1.0:1788744514.529572:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788744514.529586:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788744514.529652:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788744514.529662:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:1.0:1788744514.529696:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788744514.529705:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788744514.529736:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788744514.529786:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788744514.531842:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788744514.531875:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.106@tcp 20000000:01000000:2.0:1788744514.531878:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:2.0:1788744514.531914:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788744514.531922:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788744514.531949:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788744514.531956:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:2.0:1788744514.531996:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788744514.532006:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788744514.532980:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788744514.533105:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788744514.533155:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788744514.533158:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788744514.533163:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788744514.533177:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788744514.533180:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788744514.533220:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788744514.533222:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788744514.534094:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788744514.534575:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788744514.534695:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788744514.534773:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788744514.534798:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788744514.534800:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788744514.536982:0:6696:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788744514.537072:0:6696:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788744514.537124:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788744514.538042:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788744514.538113:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788744514.538185:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1788744514.538215:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788744514.538217:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788744514.540124:0:6697:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1788744514.540238:0:6697:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1788744514.540291:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788744514.540633:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788744514.540680:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788744514.540741:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788744514.540761:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788744514.540763:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788744514.540772:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788744514.540793:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93a200030400/0x4b162761eb391d33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.540811:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a200031a00/0x4b162761eb391c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391c45 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.540820:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a2027e7200/0x4b162761eb391c68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391c61 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.540827:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a201472e00/0x4b162761eb391cd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391cd1 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.540834:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93a200030400/0x4b162761eb391d33 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.540874:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a201472e00/0x4b162761eb391cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391cd1 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.540888:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a201472e00/0x4b162761eb391cd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391cd1 expref: 12 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744514.540900:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c782300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1875634475242624:0@lo:104: 00000100:00100000:0.0:1788744514.540963:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744514.541019:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a2027e7200/0x4b162761eb391c68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391c61 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.541040:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a2027e7200/0x4b162761eb391c68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391c61 expref: 12 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744514.541049:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1875634475242752:0@lo:104: 00000100:00100000:0.0:1788744514.541072:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744514.541105:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a200031a00/0x4b162761eb391c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391c45 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.541112:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a200031a00/0x4b162761eb391c4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391c45 expref: 12 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744514.541120:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1875634475242880:0@lo:104: 00000100:00100000:0.0:1788744514.541168:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744514.541179:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e7300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744514.541390:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475242624 00000100:00100000:2.0:1788744514.541403:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475242624 00000100:00100000:2.0:1788744514.541449:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475242752 00000100:00100000:2.0:1788744514.541452:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475242752 00000100:00100000:2.0:1788744514.541464:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475242880 00000100:00100000:2.0:1788744514.541465:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475242880 00000100:00100000:2.0:1788744514.541477:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744514.541486:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+5:5835:x1875634475242624:12345-0@lo:104: 00010000:00010000:2.0:1788744514.541500:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391cd8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744514.542030:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c782300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1875634475242624:0@lo:104: 00010000:00010000:2.0:1788744514.543019:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744514.543031:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+5:5835:x1875634475242624:12345-0@lo:104: Request processed in 1544us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744514.543040:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744514.543256:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744514.543272:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+4:5835:x1875634475242752:12345-0@lo:104: 00010000:00010000:0.0:1788744514.543287:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391c61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391c68 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.543418:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788744514.543424:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+4:5835:x1875634475242752:12345-0@lo:104: Request processed in 160us (2351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.543431:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744514.543456:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744514.543463:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+3:5835:x1875634475242880:12345-0@lo:104: 00010000:00010000:0.0:1788744514.543480:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391c45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391c4c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.543509:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788744514.543514:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+3:5835:x1875634475242880:12345-0@lo:104: Request processed in 53us (2345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.543520:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788744514.543639:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788744514.543647:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391cd8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.543655:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238530000 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744514.543660:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391cd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391cd8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.543669:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391cd8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744514.543678:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391cd8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744514.543684:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744514.543728:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391cd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391cd8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.543736:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744514.543767:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391cd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391cd8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.543775:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391cd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391cd8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.543788:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788744514.543792:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391c61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391c68 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.543797:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201472400 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744514.543800:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391c61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391c68 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.543806:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391c68 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744514.543812:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391c68 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744514.543818:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744514.543831:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391c61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391c68 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.543837:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744514.543843:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391c61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391c68 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.543849:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391c61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391c68 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.543864:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744514.543874:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391c45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391c4c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.543880:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238531a00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744514.543883:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391c45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391c4c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.543890:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391c45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391c4c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744514.543895:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391c45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391c4c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744514.543900:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744514.543914:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391c45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391c4c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.543920:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744514.543935:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391c45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391c4c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.543942:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391c45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391c4c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.543955:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744514.543957:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744514.543959:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744514.543974:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475243008:0@lo:103: 00000100:00100000:3.0:1788744514.544026:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744514.544069:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744514.544076:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475243136:0@lo:103: 00000100:00100000:3.0:1788744514.544105:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744514.544167:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475243264:0@lo:103: 00000100:00100000:3.0:1788744514.544202:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744514.544242:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475243008 00000100:00100000:3.0:1788744514.544251:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475243008 00010000:00010000:3.0:1788744514.544276:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a201472e00/0x4b162761eb391cd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391cd1 expref: 13 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744514.544294:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475243136 00000100:00100000:3.0:1788744514.544296:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475243136 00010000:00010000:3.0:1788744514.544306:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a2027e7200/0x4b162761eb391c68 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391c61 expref: 14 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744514.544316:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475243264 00000100:00100000:3.0:1788744514.544318:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475243264 00010000:00010000:3.0:1788744514.544327:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a200031a00/0x4b162761eb391c4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391c45 expref: 15 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744514.544339:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744514.544345:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+15:3307:x1875634475243008:12345-0@lo:103: 00010000:00010000:3.0:1788744514.544356:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744514.544360:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a201472e00/0x4b162761eb391cd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391cd1 expref: 15 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.544381:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a201472e00/0x4b162761eb391cd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391cd1 expref: 15 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.544397:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a201472e00/0x4b162761eb391cd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391cd1 expref: 15 pid: 5833 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.544424:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744514.544466:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+14:3307:x1875634475243008:12345-0@lo:103: Request processed in 121us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744514.544472:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744514.544485:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744514.544490:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+13:3307:x1875634475243136:12345-0@lo:103: 00010000:00010000:3.0:1788744514.544497:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744514.544500:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a2027e7200/0x4b162761eb391c68 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391c61 expref: 13 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.544508:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a2027e7200/0x4b162761eb391c68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391c61 expref: 13 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.544518:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744514.544538:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+13:3307:x1875634475243136:12345-0@lo:103: Request processed in 47us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744514.544543:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744514.544556:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744514.544562:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+12:3309:x1875634475243264:12345-0@lo:103: 00010000:00010000:3.0:1788744514.544568:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744514.544572:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a200031a00/0x4b162761eb391c4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391c45 expref: 12 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.544580:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a200031a00/0x4b162761eb391c4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391c45 expref: 12 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.544591:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93a200030400/0x4b162761eb391d33 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.544606:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a200030400/0x4b162761eb391d33 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.544623:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a200030400/0x4b162761eb391d33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.544629:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a200030400/0x4b162761eb391d33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.544636:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93a200030400/0x4b162761eb391d33 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.544643:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93a200030400/0x4b162761eb391d33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.544649:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200030400 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744514.544653:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93a200030400/0x4b162761eb391d33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.544661:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93a200030400/0x4b162761eb391d33 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.544670:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93a200030400/0x4b162761eb391d33 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.544680:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744514.544704:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+12:3309:x1875634475243264:12345-0@lo:103: Request processed in 143us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744514.544710:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744514.544750:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475243264:0@lo:103: 00000100:00100000:3.0:1788744514.544786:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475243136:0@lo:103: 00000100:00100000:3.0:1788744514.544793:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475243008:0@lo:103: 00010000:00010000:2.0:1788744514.548981:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2027e7200/0x4b162761eb391c68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391c61 expref: 11 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744514.549003:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1875634475242752:0@lo:104: 00010000:00010000:2.0:1788744514.549017:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a200031a00/0x4b162761eb391c4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391c45 expref: 10 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744514.549025:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1875634475242880:0@lo:104: 00010000:00010000:2.0:1788744514.549050:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93a200030400/0x4b162761eb391d33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.549061:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93a200030400/0x4b162761eb391d33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.549068:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93a200030400/0x4b162761eb391d33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.549096:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a200030400/0x4b162761eb391d33 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788744514.549109:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1788744514.550275:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744514.654206:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+9:6680:x1875634475242496:12345-0@lo:253: Request processed in 128468us (129452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.654222:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788744514.654352:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475242496:0@lo:253: 10000000:01000000:2.0:1788744514.654381:0:6680:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788744514.654385:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788744514.654386:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788744514.654388:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744514.654389:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788744514.654390:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744514.654391:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744514.654393:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744514.654394:0:6680:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788744514.654396:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744514.654397:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788744514.654432:0:6680:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93a210e7e800 from lustre-OST0000 10000000:01000000:2.0:1788744514.654702:0:6680:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788744514.654706:0:6680:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788744514.654713:0:6680:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93a207434d40 local copy 10000000:01000000:2.0:1788744514.654717:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788744514.654756:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201472e00/0x4b162761eb391d3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.654768:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.106@tcp lock: ffff93a201472e00/0x4b162761eb391d3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.654777:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a201472e00/0x4b162761eb391d3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744514.654799:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475243392:0@lo:101: 00000100:00100000:2.0:1788744514.654856:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744514.655002:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2208d5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788744514.655105:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475243392 00000100:00100000:1.0:1788744514.655112:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475243392 00000100:00100000:1.0:1788744514.655259:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788744514.655270:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+9:6680:x1875634475243392:12345-0@lo:101: 00010000:00010000:1.0:1788744514.655285:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744514.655299:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2027e7200/0x4b162761eb391d41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391d3a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.655323:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2027e7200/0x4b162761eb391d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391d3a expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.655332:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2027e7200/0x4b162761eb391d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391d3a expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.655351:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2027e7200, rc 0) 00000100:00100000:1.0:1788744514.655406:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+10:6680:x1875634475243392:12345-0@lo:101: Request processed in 139us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744514.655420:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788744514.655506:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475243392:0@lo:101: 00010000:00010000:2.0:1788744514.655522:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a201472e00/0x4b162761eb391d3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4b162761eb391d41 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.655530:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a201472e00/0x4b162761eb391d3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b162761eb391d41 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744514.655632:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475243520:0@lo:501: 00000100:00100000:2.0:1788744514.655659:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744514.655981:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2208d5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788744514.656056:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475243520 00000100:00100000:3.0:1788744514.656061:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475243520 00000100:00100000:3.0:1788744514.656084:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788744514.656092:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+10:6680:x1875634475243520:12345-0@lo:501: 00000100:00100000:3.0:1788744514.656391:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+10:6680:x1875634475243520:12345-0@lo:501: Request processed in 299us (730us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744514.656398:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788744514.656837:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475243520:0@lo:501: 10000000:01000000:2.0:1788744514.656857:0:6680:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788744514.656894:0:6680:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788744514.656901:0:6680:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201472e00/0x4b162761eb391d3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b162761eb391d41 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.656910:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201472e00/0x4b162761eb391d3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b162761eb391d41 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.656917:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff93a201472e00/0x4b162761eb391d3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b162761eb391d41 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.656932:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788744514.656950:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93a210e7e800 10000000:01000000:2.0:1788744514.656955:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788744514.656960:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93a207434d40 10000000:01000000:2.0:1788744514.656970:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788744514.656974:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93a207434d40 from 1 10000000:01000000:2.0:1788744514.656977:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788744514.657003:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391d48 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.657011:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391d48 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.657020:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391d48 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744514.657035:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475243648:0@lo:101: 00000100:00100000:2.0:1788744514.657067:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744514.657107:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2208d59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744514.657169:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475243648 00000100:00100000:0.0:1788744514.657175:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475243648 00000100:00100000:0.0:1788744514.657211:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788744514.657219:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+10:6680:x1875634475243648:12345-0@lo:101: 00010000:00010000:0.0:1788744514.657227:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744514.657238:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a200031200/0x4b162761eb391d4f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391d48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.657257:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a200031200/0x4b162761eb391d4f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391d48 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.657266:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a200031200/0x4b162761eb391d4f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391d48 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.657273:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a200031200, rc 0) 00000100:00100000:0.0:1788744514.657312:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+11:6680:x1875634475243648:12345-0@lo:101: Request processed in 93us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.657317:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788744514.657752:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475243648:0@lo:101: 00010000:00010000:2.0:1788744514.657768:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391d48 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d4f expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.657778:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391d48 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391d4f expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744514.657794:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788744514.657810:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391d48 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d4f expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.657817:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391d48 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d4f expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744514.657824:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788744514.657834:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788744514.657839:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788744514.657841:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788744514.657858:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.657864:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.657871:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744514.657883:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475243776:0@lo:101: 00000100:00100000:2.0:1788744514.657911:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744514.657945:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2208d59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744514.657997:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475243776 00000100:00100000:1.0:1788744514.658002:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475243776 00000100:00100000:1.0:1788744514.658047:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788744514.658055:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+11:6680:x1875634475243776:12345-0@lo:101: 00010000:00010000:1.0:1788744514.658063:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744514.658073:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2027e7800/0x4b162761eb391d5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391d56 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.658087:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2027e7800/0x4b162761eb391d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391d56 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.658095:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2027e7800/0x4b162761eb391d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391d56 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.658101:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2027e7800, rc 0) 00000100:00100000:1.0:1788744514.658157:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:6680:x1875634475243776:12345-0@lo:101: Request processed in 104us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744514.658163:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1788744514.658264:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744514.658272:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a201472e00/0x4b162761eb391d3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4b162761eb391d41 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.658279:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201472e00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744514.658283:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a201472e00/0x4b162761eb391d3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4b162761eb391d41 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.658290:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a201472e00/0x4b162761eb391d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4b162761eb391d41 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744514.658297:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a201472e00/0x4b162761eb391d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4b162761eb391d41 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744514.658303:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744514.658321:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a201472e00/0x4b162761eb391d3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b162761eb391d41 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.658326:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744514.658435:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a201472e00/0x4b162761eb391d3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b162761eb391d41 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.658517:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a201472e00/0x4b162761eb391d3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b162761eb391d41 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.658536:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744514.658539:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744514.658541:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744514.658554:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475243904:0@lo:103: 00000100:00100000:3.0:1788744514.658588:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744514.658707:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475243904 00000100:00100000:3.0:1788744514.658712:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475243904 00000100:00100000:3.0:1788744514.658746:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744514.658753:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+12:3310:x1875634475243904:12345-0@lo:103: 00010000:00010000:3.0:1788744514.658762:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744514.658776:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2027e7200/0x4b162761eb391d41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b162761eb391d3a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.658787:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744514.658818:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+11:3310:x1875634475243904:12345-0@lo:103: Request processed in 65us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744514.658824:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744514.658854:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475243904:0@lo:103: 00000100:00100000:2.0:1788744514.659101:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475243776:0@lo:101: 00010000:00010000:2.0:1788744514.659115:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391d56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d5d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.659123:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391d56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391d5d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744514.659254:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475244032:0@lo:501: 00000100:00100000:2.0:1788744514.659280:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744514.659307:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2208d59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744514.659523:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475244032 00000100:00100000:1.0:1788744514.659529:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475244032 00000100:00100000:1.0:1788744514.659568:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788744514.659575:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:6680:x1875634475244032:12345-0@lo:501: 00000100:00100000:1.0:1788744514.659920:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:6680:x1875634475244032:12345-0@lo:501: Request processed in 345us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744514.659928:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788744514.660165:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475244032:0@lo:501: 00000100:00100000:2.0:1788744514.660198:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475244160:0@lo:503: 00000100:00100000:2.0:1788744514.660238:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744514.660277:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2208d59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744514.660791:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475244160 00000100:00100000:0.0:1788744514.660798:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475244160 00000100:00100000:0.0:1788744514.660845:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788744514.660853:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+11:6680:x1875634475244160:12345-0@lo:503: 00000100:00100000:0.0:1788744514.661052:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+11:6680:x1875634475244160:12345-0@lo:503: Request processed in 199us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.661059:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788744514.661419:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475244160:0@lo:503: 00000040:00080000:3.0:1788744514.662037:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788744514.662266:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475244288:0@lo:502: 00000100:00100000:3.0:1788744514.662324:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744514.662391:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c785480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744514.662597:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475244288 00000100:00100000:0.0:1788744514.662604:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475244288 00000100:00100000:0.0:1788744514.662727:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788744514.662737:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+11:6680:x1875634475244288:12345-0@lo:502: 00000100:00100000:0.0:1788744514.662923:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+11:6680:x1875634475244288:12345-0@lo:502: Request processed in 187us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.662930:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788744514.663017:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475244288:0@lo:502: 00000040:00080000:3.0:1788744514.663334:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788744514.663409:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788744514.663578:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788744514.663704:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788744514.663745:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788744514.663779:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788744514.663815:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475244416:0@lo:502: 00000100:00100000:3.0:1788744514.663864:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744514.663964:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c785480 going to sleep for 11 seconds 00000100:00100000:1.0:1788744514.664078:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475244416 00000100:00100000:1.0:1788744514.664085:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475244416 00000100:00100000:1.0:1788744514.664179:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788744514.664189:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:6680:x1875634475244416:12345-0@lo:502: 00000100:00100000:1.0:1788744514.664926:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:6680:x1875634475244416:12345-0@lo:502: Request processed in 738us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744514.664935:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788744514.665205:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475244416:0@lo:502: 00000040:00080000:3.0:1788744514.665404:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788744514.665419:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788744514.666768:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788744514.666778:0:6699:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788744514.666784:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744514.666787:0:6699:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788744514.666792:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744514.666807:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93a220a799c0) 00000020:00000080:1.0:1788744514.666829:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788744514.666835:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788744514.666887:0:6699:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93a210e7e800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788744514.666893:0:6699:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788744514.666899:0:6699:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b162761eb391d6b 00010000:00010000:1.0:1788744514.675852:0:6699:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788744514.676566:0:6699:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00010000:00010000:2.0:1788744514.677628:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788744514.683023:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788744514.683946:0:6699:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788744514.705209:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788744514.705712:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788744514.711977:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788744514.711991:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744514.711999:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744514.712002:0:6699:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788744514.712006:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744514.712010:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744514.712012:0:6699:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788744514.712015:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788744514.712017:0:6699:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788744514.712081:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744514.712085:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744514.712086:0:6699:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788744514.712090:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788744514.713265:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788744514.713301:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788744514.713322:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391d56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d5d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.713336:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391d56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d5d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744514.713357:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a210e7e800 from 1 10000000:01000000:3.0:1788744514.713360:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788744514.713411:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391d72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.713420:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391d72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.713572:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391d72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744514.713597:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475244544:0@lo:101: 00000100:00100000:3.0:1788744514.713676:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744514.713724:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c7853c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744514.716113:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475244544 00000100:00100000:1.0:1788744514.716148:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475244544 00000100:00100000:1.0:1788744514.716211:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788744514.716223:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:6680:x1875634475244544:12345-0@lo:101: 00010000:00010000:1.0:1788744514.716240:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744514.716260:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2027e7400/0x4b162761eb391d79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391d72 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.716288:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2027e7400/0x4b162761eb391d79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391d72 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.716309:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2027e7400/0x4b162761eb391d79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391d72 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.716332:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2027e7400, rc 0) 00000100:00100000:1.0:1788744514.716479:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+12:6680:x1875634475244544:12345-0@lo:101: Request processed in 258us (2802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744514.716486:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788744514.719917:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475244544:0@lo:101: 00010000:00010000:0.0:1788744514.719957:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391d72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d79 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.719980:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391d72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391d79 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744514.720113:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475244672:0@lo:501: 00000100:00100000:0.0:1788744514.720193:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744514.720237:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744514.720481:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475244672 00000100:00100000:1.0:1788744514.720487:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475244672 00000100:00100000:1.0:1788744514.720526:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788744514.720535:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:6680:x1875634475244672:12345-0@lo:501: 00000100:00100000:1.0:1788744514.720773:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:6680:x1875634475244672:12345-0@lo:501: Request processed in 239us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744514.720781:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788744514.721387:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475244672:0@lo:501: 00000100:00100000:0.0:1788744514.721438:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475244800:0@lo:503: 00000100:00100000:0.0:1788744514.721484:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744514.721519:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744514.721554:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475244800 00000100:00100000:0.0:1788744514.721559:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475244800 00000100:00100000:0.0:1788744514.721591:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788744514.721599:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:6680:x1875634475244800:12345-0@lo:503: 00000100:00100000:0.0:1788744514.722078:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:6680:x1875634475244800:12345-0@lo:503: Request processed in 478us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.722086:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788744514.722103:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475244800:0@lo:503: 00000040:00080000:1.0:1788744514.722415:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788744514.722489:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475244928:0@lo:502: 00000100:00100000:1.0:1788744514.722528:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744514.722552:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a22042b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744514.722636:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475244928 00000100:00100000:0.0:1788744514.722641:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475244928 00000100:00100000:0.0:1788744514.722673:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788744514.722680:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:6680:x1875634475244928:12345-0@lo:502: 00000100:00100000:0.0:1788744514.722843:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:6680:x1875634475244928:12345-0@lo:502: Request processed in 163us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.722850:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788744514.724087:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475244928:0@lo:502: 00000040:00080000:1.0:1788744514.724427:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788744514.724498:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788744514.724533:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475245056:0@lo:502: 00000100:00100000:1.0:1788744514.724586:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744514.724683:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475245056 00000100:00100000:0.0:1788744514.724695:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475245056 00000100:00100000:0.0:1788744514.724748:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788744514.724757:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:6680:x1875634475245056:12345-0@lo:502: 00000100:00100000:1.0:1788744514.724803:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a22042b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744514.724935:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:6680:x1875634475245056:12345-0@lo:502: Request processed in 179us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.724949:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788744514.725607:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475245056:0@lo:502: 00000040:00080000:1.0:1788744514.725727:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788744514.725745:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788744514.726983:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744514.726995:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744514.726997:0:6703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788744514.727004:0:6703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93a210e7e800 00000020:00000080:0.0:1788744514.727006:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788744514.727028:0:6703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744514.727032:0:6703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744514.727033:0:6703:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788744514.727036:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788744514.728302:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788744514.728533:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744514.728555:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391d72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d79 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.728569:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391d72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d79 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744514.728691:0:6680:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788744514.728695:0:6680:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93a210e7e800 10000000:01000000:1.0:1788744514.728698:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93a210e7e800 10000000:01000000:1.0:1788744514.728703:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788744514.728709:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93a210e7e800 from 1 10000000:01000000:1.0:1788744514.728712:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788744514.728751:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.728761:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.728773:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391d80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744514.728796:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475245184:0@lo:101: 00000100:00100000:1.0:1788744514.728859:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744514.728949:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a22042bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744514.733805:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475245184 00000100:00100000:2.0:1788744514.733823:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475245184 00000100:00100000:3.0:1788744514.736929:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788744514.736945:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:6680:x1875634475245184:12345-0@lo:101: 00010000:00010000:3.0:1788744514.736964:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744514.736985:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a238530000/0x4b162761eb391d87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391d80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.737018:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a238530000/0x4b162761eb391d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391d80 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.737030:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a238530000/0x4b162761eb391d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391d80 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.737039:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a238530000, rc 0) 00000100:00100000:3.0:1788744514.737120:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+13:6680:x1875634475245184:12345-0@lo:101: Request processed in 179us (8261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744514.737160:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788744514.737708:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475245184:0@lo:101: 00010000:00010000:1.0:1788744514.737728:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391d80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d87 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744514.737758:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391d80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391d87 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744514.737879:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475245312:0@lo:501: 00000100:00100000:1.0:1788744514.737918:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744514.739415:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a22042bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744514.740159:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475245312 00000100:00100000:0.0:1788744514.740179:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475245312 00000100:00100000:0.0:1788744514.740235:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788744514.740245:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:6680:x1875634475245312:12345-0@lo:501: 00000100:00100000:0.0:1788744514.740607:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:6680:x1875634475245312:12345-0@lo:501: Request processed in 363us (2687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.740615:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788744514.740941:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475245312:0@lo:501: 00000100:00100000:0.0:1788744514.740992:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475245440:0@lo:503: 00000100:00100000:0.0:1788744514.741038:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744514.741057:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a206484d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744514.741075:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475245440 00000100:00100000:0.0:1788744514.741079:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475245440 00000100:00100000:0.0:1788744514.741104:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788744514.741110:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:6680:x1875634475245440:12345-0@lo:503: 00000100:00100000:0.0:1788744514.741303:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:6680:x1875634475245440:12345-0@lo:503: Request processed in 191us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.741309:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788744514.741436:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475245440:0@lo:503: 00000040:00080000:0.0:1788744514.741810:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788744514.741870:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475245568:0@lo:502: 00000100:00100000:0.0:1788744514.741908:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744514.741928:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a206484d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744514.741945:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475245568 00000100:00100000:0.0:1788744514.741949:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475245568 00000100:00100000:0.0:1788744514.741968:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788744514.741973:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:6680:x1875634475245568:12345-0@lo:502: 00000100:00100000:0.0:1788744514.742126:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:6680:x1875634475245568:12345-0@lo:502: Request processed in 151us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.742156:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788744514.742198:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475245568:0@lo:502: 00000040:00080000:0.0:1788744514.742976:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788744514.743032:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788744514.743063:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788744514.743105:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788744514.744031:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788744514.744111:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788744514.744164:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788744514.744204:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788744514.744279:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788744514.744694:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788744514.744747:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788744514.744800:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788744514.744837:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788744514.744873:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788744514.744922:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788744514.744960:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788744514.744993:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788744514.745041:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788744514.745079:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788744514.745115:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788744514.753547:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788744514.753615:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788744514.753667:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788744514.753744:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788744514.753796:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788744514.753831:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788744514.753882:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788744514.753918:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788744514.753967:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475245696:0@lo:502: 00000100:00100000:0.0:1788744514.754040:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744514.754100:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a206484d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744514.754480:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475245696 00000100:00100000:2.0:1788744514.754488:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475245696 00000100:00100000:2.0:1788744514.754541:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788744514.754552:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:6680:x1875634475245696:12345-0@lo:502: 00000100:00100000:2.0:1788744514.754877:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:6680:x1875634475245696:12345-0@lo:502: Request processed in 327us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744514.754884:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788744514.754981:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475245696:0@lo:502: 00000040:00080000:0.0:1788744514.755059:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788744514.755072:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788744514.766894:0:6704:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788744514.766911:0:6704:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93a220a7b380) 00000020:00000080:1.0:1788744514.766943:0:6704:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788744514.767020:0:6704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93a210e7e800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788744514.767024:0:6704:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93a210e7e800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788744514.767027:0:6704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93a210e7e800 3 00010000:00080000:1.0:1788744514.767054:0:6704:0:(ldlm_lib.c:103:import_set_conn()) imp ffff93a10551a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.106@tcp at head 00010000:00010000:1.0:1788744514.770975:0:6704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788744514.771212:0:6704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788744514.771252:0:6704:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788744514.771266:0:6704:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4b162761eb391d95 00000100:00080000:1.0:1788744514.771276:0:6704:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744514.771288:0:6704:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93a10551a800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1788744514.771322:0:6704:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a220a57b80 x1875634475245824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744514.772181:0:6704:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788744514.772254:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875634475245824:0@lo:38: 00000100:00100000:0.0:1788744514.772326:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744514.772417:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475245824 00000100:00100000:0.0:1788744514.772424:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475245824 00000100:00100000:0.0:1788744514.772456:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744514.772462:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875634475245824:12345-0@lo:38: 00010000:00080000:0.0:1788744514.772498:0:5842:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:0.0:1788744514.772529:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4b162761eb391d9c 00000004:00100000:0.0:1788744514.772544:0:5842:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788744514.772572:0:5842:0:(import.c:65:import_set_state_nolock()) ffff93a105512800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744514.772965:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875634475245824:12345-0@lo:38: Request processed in 152us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744514.772976:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788744514.773022:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a220a57b80 x1875634475245824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744514.773033:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744514.773041:0:3306:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788744514.773048:0:3306:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788744514.773053:0:3306:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788744514.773055:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a10551a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788744514.773060:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875634475245824:0@lo:38: 00000040:00080000:3.0:1788744514.773693:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1788744514.774592:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475245952:0@lo:400: 00000100:00100000:3.0:1788744514.774659:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744514.774727:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475245952 00000100:00100000:3.0:1788744514.774734:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475245952 00000100:00100000:3.0:1788744514.774794:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744514.774802:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475245952:12345-0@lo:400: 00000100:00100000:3.0:1788744514.774849:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475245952:12345-0@lo:400: Request processed in 48us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744514.774856:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788744514.774892:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23b4c1180 x1875634475245952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744514.774906:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475245952:0@lo:400: 00000020:01000000:0.0:1788744514.778766:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788744514.778801:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788744514.778826:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391d80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d87 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.778990:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391d87 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788744514.779068:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788744514.779070:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788744514.779072:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744514.779073:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744514.779079:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744514.779080:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744514.779082:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788744514.779084:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788744514.779085:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788744514.779087:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744514.779088:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788744514.779092:0:6680:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788744514.779094:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788744514.779095:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788744514.779096:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744514.779097:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744514.779098:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744514.779099:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744514.779100:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788744514.779101:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788744514.779102:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788744514.779103:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744514.779104:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788744514.779154:0:6680:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788744514.779174:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475246080:0@lo:253: 00000100:00100000:0.0:1788744514.779240:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744514.779281:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a206484d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744514.779450:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475246080 00000100:00100000:1.0:1788744514.779457:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475246080 00000100:00100000:1.0:1788744514.779504:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788744514.779513:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+13:6680:x1875634475246080:12345-0@lo:253: 20000000:01000000:1.0:1788744514.780851:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788744514.780884:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788744514.839798:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788744514.839817:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788744514.840593:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788744514.840601:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788744514.840636:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93a200031800/0x4b162761eb391da3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.840655:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a238531400/0x4b162761eb391d02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391cfb expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.840664:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93a200031800/0x4b162761eb391da3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.840715:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a238531400/0x4b162761eb391d02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391cfb expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744514.840747:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a238531400/0x4b162761eb391d02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391cfb expref: 13 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744514.840763:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c782d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875634475246208:0@lo:104: 00000100:00100000:0.0:1788744514.840835:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744514.840906:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a206484180 going to sleep for 11 seconds 00000100:00100000:3.0:1788744514.841033:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475246208 00000100:00100000:3.0:1788744514.841043:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475246208 00000100:00100000:3.0:1788744514.841097:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744514.841107:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+3:5856:x1875634475246208:12345-0@lo:104: 00010000:00010000:3.0:1788744514.841122:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a201472200/0x4b162761eb391cfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391d02 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.841216:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788744514.841223:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+3:5856:x1875634475246208:12345-0@lo:104: Request processed in 118us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744514.841230:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788744514.841252:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744514.841259:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a201472200/0x4b162761eb391cfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391d02 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.841266:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201472200 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744514.841270:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a201472200/0x4b162761eb391cfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391d02 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.841291:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a201472200/0x4b162761eb391cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391d02 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744514.841299:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a201472200/0x4b162761eb391cfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391d02 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744514.841305:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744514.841336:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a201472200/0x4b162761eb391cfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391d02 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.841354:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744514.841379:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a201472200/0x4b162761eb391cfb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391d02 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.841387:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a201472200/0x4b162761eb391cfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391d02 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.841410:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744514.841411:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744514.841413:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744514.841430:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475246336:0@lo:103: 00000100:00100000:3.0:1788744514.841462:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744514.841506:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475246336 00000100:00100000:3.0:1788744514.841510:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475246336 00010000:00010000:3.0:1788744514.841528:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a238531400/0x4b162761eb391d02 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391cfb expref: 14 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744514.841549:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744514.841555:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+14:3308:x1875634475246336:12345-0@lo:103: 00010000:00010000:3.0:1788744514.841585:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744514.841591:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a238531400/0x4b162761eb391d02 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391cfb expref: 14 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.841600:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a238531400/0x4b162761eb391d02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391cfb expref: 14 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.841615:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93a200031800/0x4b162761eb391da3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.841623:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a200031800/0x4b162761eb391da3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788744514.841637:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001557290s 00010000:00010000:3.0:1788744514.841642:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a200031800/0x4b162761eb391da3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.841649:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a200031800/0x4b162761eb391da3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.841655:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93a200031800/0x4b162761eb391da3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.841662:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93a200031800/0x4b162761eb391da3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.841667:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200031800 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744514.841671:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93a200031800/0x4b162761eb391da3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.841678:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93a200031800/0x4b162761eb391da3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.841693:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93a200031800/0x4b162761eb391da3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744514.841703:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744514.841730:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+14:3308:x1875634475246336:12345-0@lo:103: Request processed in 176us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744514.841737:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744514.841799:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475246336:0@lo:103: 00010000:00010000:2.0:1788744514.841893:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a238531400/0x4b162761eb391d02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391cfb expref: 13 pid: 5834 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744514.841905:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c782d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875634475246208:0@lo:104: 00010000:00010000:2.0:1788744514.841931:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93a200031800/0x4b162761eb391da3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.841941:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93a200031800/0x4b162761eb391da3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.841947:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93a200031800/0x4b162761eb391da3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744514.841954:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a200031800/0x4b162761eb391da3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744514.858820:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+12:6680:x1875634475246080:12345-0@lo:253: Request processed in 79296us (79567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744514.858835:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788744514.858944:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:6680:1875634475246080:0@lo:253: 10000000:01000000:0.0:1788744514.858960:0:6680:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788744514.858964:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788744514.858966:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788744514.858967:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744514.858968:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744514.858969:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744514.858971:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744514.858972:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788744514.858974:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788744514.858975:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788744514.858977:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744514.858978:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788744514.858992:0:6680:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788744514.863941:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744514.864119:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744514.864750:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744514.864923:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744514.865169:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744514.865547:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788744514.868064:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788744515.100509:0:6680:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788744515.100530:0:6680:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788744515.100573:0:6680:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788744515.100751:0:6680:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788744515.100769:0:6680:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788744515.100800:0:6680:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788744515.703747:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744516.743491:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788744517.300591:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788744517.300599:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93a203f6f000 from 21 10000000:01000000:3.0:1788744517.300604:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788744517.300656:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a238530400/0x4b162761eb391daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744517.300668:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a238530400/0x4b162761eb391daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744517.300680:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a238530400/0x4b162761eb391daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744517.300705:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475246464:0@lo:101: 00000100:00100000:3.0:1788744517.300772:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744517.300830:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475246464 00000100:00100000:2.0:1788744517.300839:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475246464 00000100:00100000:3.0:1788744517.300844:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20d4e3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744517.300893:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788744517.300902:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:5837:x1875634475246464:12345-0@lo:101: 00010000:00010000:2.0:1788744517.300915:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744517.300928:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a201473c00/0x4b162761eb391db1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391daa expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744517.300951:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a201473c00/0x4b162761eb391db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391daa expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744517.300962:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a201473c00/0x4b162761eb391db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391daa expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744517.300971:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a201473c00, rc 0) 00000100:00100000:2.0:1788744517.301014:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:5837:x1875634475246464:12345-0@lo:101: Request processed in 113us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744517.301021:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788744517.301273:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475246464:0@lo:101: 00010000:00010000:3.0:1788744517.301300:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a238530400/0x4b162761eb391daa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391db1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744517.301309:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a238530400/0x4b162761eb391daa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391db1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744517.301363:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475246592:0@lo:501: 00000100:00100000:3.0:1788744517.301381:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744517.301463:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475246592 00000100:00100000:1.0:1788744517.301468:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475246592 00000100:00100000:3.0:1788744517.301471:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20d4e3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744517.301499:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788744517.301506:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+13:5837:x1875634475246592:12345-0@lo:501: 00000100:00100000:1.0:1788744517.302106:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+13:5837:x1875634475246592:12345-0@lo:501: Request processed in 600us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744517.302113:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788744517.302346:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475246592:0@lo:501: 00000100:00100000:3.0:1788744517.302378:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475246720:0@lo:503: 00000100:00100000:3.0:1788744517.302416:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744517.302488:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20d4e3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744517.302526:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475246720 00000100:00100000:0.0:1788744517.302531:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475246720 00000100:00100000:0.0:1788744517.302600:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788744517.302615:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+13:5837:x1875634475246720:12345-0@lo:503: 00000100:00100000:0.0:1788744517.302918:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+13:5837:x1875634475246720:12345-0@lo:503: Request processed in 304us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744517.302926:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788744517.302992:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475246720:0@lo:503: 00000100:00100000:3.0:1788744517.303520:0:6825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:6825:1875634475246848:0@lo:502: 00000100:00100000:3.0:1788744517.303559:0:6825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744517.307082:0:6825:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20d4e3780 going to sleep for 11 seconds 00000100:00100000:2.0:1788744517.307704:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475246848 00000100:00100000:2.0:1788744517.307871:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475246848 00000100:00100000:2.0:1788744517.307912:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788744517.307920:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:6825:x1875634475246848:12345-0@lo:502: 00000100:00100000:2.0:1788744517.308349:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:6825:x1875634475246848:12345-0@lo:502: Request processed in 428us (4787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744517.308364:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788744517.308460:0:6825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:6825:1875634475246848:0@lo:502: 00000100:00100000:3.0:1788744517.308527:0:6825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:6825:1875634475246976:0@lo:502: 00000100:00100000:3.0:1788744517.308563:0:6825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744517.308599:0:6825:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20d4e3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788744517.308691:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475246976 00000100:00100000:0.0:1788744517.308695:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475246976 00000100:00100000:0.0:1788744517.308724:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788744517.308731:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+13:6825:x1875634475246976:12345-0@lo:502: 00000100:00100000:0.0:1788744517.308856:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+13:6825:x1875634475246976:12345-0@lo:502: Request processed in 126us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744517.308863:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788744517.309021:0:6825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:6825:1875634475246976:0@lo:502: 00000040:00080000:3.0:1788744517.309038:0:6825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788744517.309336:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788744517.309351:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788744517.309360:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a238530400/0x4b162761eb391daa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391db1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744517.309371:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a238530400/0x4b162761eb391daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391db1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744517.309380:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788744517.309382:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93a203f6f000 from 4 10000000:01000000:0.0:1788744517.309385:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788744517.309411:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744517.309419:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744517.309427:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744517.309444:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475247104:0@lo:101: 00000100:00100000:0.0:1788744517.309469:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744517.309495:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2048496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744517.309535:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475247104 00000100:00100000:3.0:1788744517.309539:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475247104 00000100:00100000:3.0:1788744517.309655:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788744517.309664:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+13:5837:x1875634475247104:12345-0@lo:101: 00010000:00010000:3.0:1788744517.309680:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744517.309693:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a238530a00/0x4b162761eb391dbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391db8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744517.309719:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a238530a00/0x4b162761eb391dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391db8 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744517.309729:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a238530a00/0x4b162761eb391dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391db8 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744517.309737:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a238530a00, rc 0) 00000100:00100000:3.0:1788744517.309769:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+14:5837:x1875634475247104:12345-0@lo:101: Request processed in 106us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744517.309808:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475247104:0@lo:101: 00010000:00010000:0.0:1788744517.309819:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391db8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391dbf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744517.309828:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391db8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391dbf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744517.309864:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475247232:0@lo:256: 00000100:00100000:0.0:1788744517.309889:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744517.309896:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2048496c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744517.310593:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475247232 00000100:00100000:1.0:1788744517.310600:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475247232 00000100:00100000:3.0:1788744517.310956:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788744517.311057:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788744517.311067:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+14:5837:x1875634475247232:12345-0@lo:256: 20000000:01000000:1.0:1788744517.311085:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788744517.311104:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788744517.311107:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788744517.311223:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+14:5837:x1875634475247232:12345-0@lo:256: Request processed in 158us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744517.311241:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788744517.311306:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475247232:0@lo:256: 10000000:01000000:0.0:1788744517.311357:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788744517.311365:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391db8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391dbf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744517.311375:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391dbf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744517.311383:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788744517.311385:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788744517.311388:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788744517.311409:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a200031e00/0x4b162761eb391dc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744517.311425:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a200031e00/0x4b162761eb391dc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744517.311434:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a200031e00/0x4b162761eb391dc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744517.311447:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475247360:0@lo:101: 00000100:00100000:0.0:1788744517.311474:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744517.327197:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2048496c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744517.330065:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475247360 00000100:00100000:2.0:1788744517.330083:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475247360 00000100:00100000:2.0:1788744517.330156:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788744517.330168:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a203d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+14:5837:x1875634475247360:12345-0@lo:101: 00010000:00010000:2.0:1788744517.330187:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744517.330212:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a201472600/0x4b162761eb391dcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391dc6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744517.331061:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a201472600/0x4b162761eb391dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391dc6 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744517.331076:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a201472600/0x4b162761eb391dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391dc6 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744517.331085:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a201472600, rc 0) 00000100:00100000:3.0:1788744517.331222:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a203d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475247360:12345-0@lo:101: Request processed in 1056us (19746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744517.331440:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475247360:0@lo:101: 00010000:00010000:1.0:1788744517.331460:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a200031e00/0x4b162761eb391dc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391dcd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744517.331470:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a200031e00/0x4b162761eb391dc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391dcd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744517.331557:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475247488:0@lo:501: 00000100:00100000:1.0:1788744517.331607:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744517.331641:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1056179c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744517.331820:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475247488 00000100:00100000:2.0:1788744517.331826:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475247488 00000100:00100000:3.0:1788744517.331861:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788744517.332104:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788744517.332116:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a203d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475247488:12345-0@lo:501: 00000100:00100000:2.0:1788744517.332550:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a203d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475247488:12345-0@lo:501: Request processed in 436us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744517.332558:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788744517.332706:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475247488:0@lo:501: 00000100:00100000:1.0:1788744517.332739:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475247616:0@lo:503: 00000100:00100000:1.0:1788744517.332780:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744517.333054:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1056179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744517.333223:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475247616 00000100:00100000:3.0:1788744517.333289:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475247616 00000100:00100000:3.0:1788744517.333317:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788744517.333334:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475247616:12345-0@lo:503: 00000100:00100000:3.0:1788744517.333824:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475247616:12345-0@lo:503: Request processed in 499us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744517.333831:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788744517.336026:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475247616:0@lo:503: 00000100:00100000:2.0:1788744517.336660:0:6826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:6826:1875634475247744:0@lo:502: 00000100:00100000:2.0:1788744517.336833:0:6826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744517.336958:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475247744 00000100:00100000:1.0:1788744517.336964:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475247744 00000100:00100000:1.0:1788744517.337001:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788744517.337011:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+15:6826:x1875634475247744:12345-0@lo:502: 00000100:00100000:1.0:1788744517.337408:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+15:6826:x1875634475247744:12345-0@lo:502: Request processed in 397us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744517.337417:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788744517.337502:0:6826:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744517.337519:0:6826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:6826:1875634475247744:0@lo:502: 00000020:01000000:2.0:1788744517.337547:0:6826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788744517.337556:0:6826:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788744517.337564:0:6826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744517.337566:0:6826:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788744517.337583:0:6826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788744517.337587:0:6826:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:2.0:1788744517.337609:0:6826:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788744517.337621:0:6826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788744517.337634:0:6826:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93a23c6999c0) 00000020:00000080:2.0:1788744517.337657:0:6826:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788744517.337664:0:6826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788744517.337844:0:6826:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788744517.337850:0:6826:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788744517.337861:0:6826:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b162761eb391ddb 00010000:00080000:2.0:1788744517.338037:0:6826:0:(ldlm_lib.c:103:import_set_conn()) imp ffff93a2065f4800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:2.0:1788744517.338369:0:6826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788744517.413834:0:6826:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788744517.413860:0:6826:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788744517.415086:0:6826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744517.416482:0:6826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744517.416544:0:6826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788744517.416810:0:6826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788744517.417768:0:6828:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744517.417774:0:6828:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788744517.418790:0:6826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788744517.418803:0:6826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788744517.418837:0:6826:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788744517.418858:0:6826:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b162761eb391de2 00000100:00080000:3.0:1788744517.418868:0:6826:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744517.418891:0:6826:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93a2065f4800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1788744517.418928:0:6826:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23d635c00 x1875634475247872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744517.418954:0:6826:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788744517.419021:0:6826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744517.419025:0:6826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744517.419028:0:6826:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788744517.419031:0:6826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744517.419035:0:6826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744517.419037:0:6826:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788744517.419039:0:6826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788744517.419041:0:6826:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788744517.419066:0:6826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:6826:1875634475248000:0@lo:502: 00000100:00100000:3.0:1788744517.419177:0:6826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744517.419344:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475247872:0@lo:8: 00000100:00100000:0.0:1788744517.419381:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744517.419757:0:6826:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20898c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788744517.419785:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475247872 00000100:00100000:3.0:1788744517.419792:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475247872 00000100:00100000:3.0:1788744517.419834:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744517.419841:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875634475247872:12345-0@lo:8: 00010000:00080000:3.0:1788744517.419866:0:6682:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:3.0:1788744517.419891:0:6682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b162761eb391de9 00002000:00100000:3.0:1788744517.419921:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93a105272800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788744517.419926:0:6682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788744517.419930:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788744517.420126:0:6682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788744517.420205:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475248128:0@lo:400: 00000100:00100000:2.0:1788744517.420255:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744517.420280:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744517.420286:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475248256:0@lo:400: 00000100:00100000:2.0:1788744517.420448:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744517.420482:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475248128 00000100:00100000:2.0:1788744517.420486:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475248128 00000100:00100000:2.0:1788744517.420524:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475248256 00000100:00100000:2.0:1788744517.420528:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475248256 00000100:00100000:2.0:1788744517.420555:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744517.420639:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475248128:12345-0@lo:400: 00000100:00100000:2.0:1788744517.420762:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475248128:12345-0@lo:400: Request processed in 200us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744517.420770:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744517.420788:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744517.420794:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475248256:12345-0@lo:400: 00000100:00100000:2.0:1788744517.420821:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475248256:12345-0@lo:400: Request processed in 27us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744517.420827:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788744517.420861:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788744517.420888:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23b4c0000 x1875634475248256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744517.420902:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475248256:0@lo:400: 00010000:00080000:2.0:1788744517.420913:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23b4c0700 x1875634475248128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744517.420921:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475248128:0@lo:400: 00002000:00080000:3.0:1788744517.421974:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788744517.422004:0:6682:0:(import.c:65:import_set_state_nolock()) ffff93a105277800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744517.422068:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875634475247872:12345-0@lo:8: Request processed in 2225us (2684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744517.422076:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788744517.422181:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23d635c00 x1875634475247872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788744527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744517.422192:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788744517.422199:0:3306:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788744517.422208:0:3306:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788744517.422213:0:3306:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788744517.422216:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a2065f4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788744517.422239:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788744517.422244:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475247872:0@lo:8: 00000004:00080000:3.0:1788744517.422422:0:6828:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788744517.422519:0:6828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 220121388659ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788744517.423989:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475248000 00000100:00100000:1.0:1788744517.424002:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475248000 00000100:00100000:1.0:1788744517.424047:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788744517.424056:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+15:6826:x1875634475248000:12345-0@lo:502: 00000100:00100000:1.0:1788744517.424339:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+15:6826:x1875634475248000:12345-0@lo:502: Request processed in 284us (5161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744517.424347:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788744517.424403:0:6826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:6826:1875634475248000:0@lo:502: 00000020:01000000:1.0:1788744517.424437:0:6826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744517.424444:0:6826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744517.424447:0:6826:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788744517.424453:0:6826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788744517.424759:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788744517.424779:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788744517.424789:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a200031e00/0x4b162761eb391dc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391dcd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744517.424808:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a200031e00/0x4b162761eb391dc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391dcd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744517.424818:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788744517.424820:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93a207434d40 from 1 10000000:01000000:1.0:1788744517.424823:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788744517.424854:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2027e7200/0x4b162761eb391df0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744517.424863:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a2027e7200/0x4b162761eb391df0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744517.424872:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a2027e7200/0x4b162761eb391df0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744517.424890:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475248384:0@lo:101: 00000100:00100000:1.0:1788744517.424927:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744517.424959:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a105617240 going to sleep for 11 seconds 00000100:00100000:1.0:1788744517.424975:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475248384 00000100:00100000:1.0:1788744517.424979:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475248384 00000100:00100000:1.0:1788744517.425001:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788744517.425008:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475248384:12345-0@lo:101: 00010000:00010000:1.0:1788744517.425017:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744517.425030:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2027e6400/0x4b162761eb391df7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391df0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744517.425051:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2027e6400/0x4b162761eb391df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391df0 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744517.425071:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2027e6400/0x4b162761eb391df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391df0 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744517.425079:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2027e6400, rc 0) 00000100:00100000:1.0:1788744517.425106:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475248384:12345-0@lo:101: Request processed in 99us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744517.425111:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788744517.425157:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475248384:0@lo:101: 00010000:00010000:1.0:1788744517.425168:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a2027e7200/0x4b162761eb391df0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391df7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744517.425176:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a2027e7200/0x4b162761eb391df0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391df7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744517.425214:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475248512:0@lo:501: 00000100:00100000:1.0:1788744517.425236:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744517.425249:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a105617240 going to sleep for 11 seconds 00000100:00100000:1.0:1788744517.425261:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475248512 00000100:00100000:1.0:1788744517.425264:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475248512 00000100:00100000:1.0:1788744517.425283:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788744517.425289:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475248512:12345-0@lo:501: 00000100:00100000:1.0:1788744517.425494:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475248512:12345-0@lo:501: Request processed in 205us (256us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788744517.425501:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788744517.425530:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475248512:0@lo:501: 10000000:01000000:1.0:1788744517.425545:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788744517.425555:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2027e7200/0x4b162761eb391df0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391df7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744517.425772:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a2027e7200/0x4b162761eb391df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391df7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744517.540166:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475248640:0@lo:13: 00000100:00100000:3.0:1788744517.540258:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788744517.540336:0:6829:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788744517.540358:0:6829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6829:1875634475248768:0@lo:7: 00000100:00100000:3.0:1788744517.540383:0:6829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744517.540402:0:6829:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20898cd80 going to sleep for 11 seconds 00000004:00080000:2.0:1788744517.540533:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788744517.541090:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475248640 00000100:00100000:0.0:1788744517.541098:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475248640 00000100:00100000:0.0:1788744517.541166:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744517.541176:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875634475248640:12345-0@lo:13: 00002000:00000024:0.0:1788744517.541208:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788744517.541257:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875634475248640:12345-0@lo:13: Request processed in 84us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744517.541264:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788744517.541314:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23d637b80 x1875634475248640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744517.541342:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475248640:0@lo:13: 00000100:00080000:2.0:1788744517.541922:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744517.542331:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475248768 00000100:00100000:2.0:1788744517.542338:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475248768 00000100:00100000:2.0:1788744517.542372:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744517.542379:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6829:x1875634475248768:12345-0@lo:7: 00002000:00080000:2.0:1788744517.556344:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788744517.556355:0:6685:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788744517.556458:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6829:x1875634475248768:12345-0@lo:7: Request processed in 14074us (16068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744517.556469:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788744517.557186:0:6829:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23d635880 x1875634475248768/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788744533 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744517.557207:0:6829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6829:1875634475248768:0@lo:7: 00000004:00080000:3.0:1788744517.557221:0:6829:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788744517.557256:0:6829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6829:1875634475248896:0@lo:5: 00000100:00100000:3.0:1788744517.557292:0:6829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744517.557348:0:6829:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20898cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744517.557406:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475248896 00000100:00100000:0.0:1788744517.557412:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475248896 00000100:00100000:0.0:1788744517.557458:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744517.557468:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6829:x1875634475248896:12345-0@lo:5: 00002000:00080000:0.0:1788744517.557498:0:6682:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788744517.557502:0:6682:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788744517.558802:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6829:x1875634475248896:12345-0@lo:5: Request processed in 522us (695us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788744517.558812:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788744517.558850:0:6829:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23d635880 x1875634475248896/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744533 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744517.558863:0:6829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6829:1875634475248896:0@lo:5: 00000004:00080000:0.0:1788744517.558874:0:6829:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788744517.558901:0:6829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6829:1875634475249024:0@lo:700: 00000100:00100000:0.0:1788744517.558934:0:6829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744517.558969:0:6829:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203fa9180 going to sleep for 11 seconds 00000100:00100000:2.0:1788744517.559263:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475249024 00000100:00100000:2.0:1788744517.559269:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475249024 00000100:00100000:2.0:1788744517.560433:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744517.560447:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6829:x1875634475249024:12345-0@lo:700: 00000100:00100000:2.0:1788744517.560495:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6691:1875634475249152:0@lo:700: 00000100:00100000:2.0:1788744517.560548:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744517.560786:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4600 going to sleep for 11 seconds 00000100:00100000:2.0:1788744517.560808:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475249152 00000100:00100000:2.0:1788744517.560812:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475249152 00000100:00100000:2.0:1788744517.560851:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744517.560858:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6691:x1875634475249152:12345-0@lo:700: 40000000:02000000:2.0:1788744517.633789:0:5847:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788744517.645490:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6691:x1875634475249152:12345-0@lo:700: Request processed in 84623us (84931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744517.645656:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788744517.645846:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23b4c0700 x1875634475249152/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788744533 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744517.645863:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6691:1875634475249152:0@lo:700: 40000000:02000000:3.0:1788744517.645876:0:6691:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:2.0:1788744517.757117:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788744517.768000:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788744517.768040:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788744517.768347:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6829:x1875634475249024:12345-0@lo:700: Request processed in 207899us (209406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744517.768359:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788744517.768430:0:6829:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23c783800 x1875634475249024/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788744533 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744517.768442:0:6829:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788744517.768458:0:6829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6829:1875634475249024:0@lo:700: 00000004:02000040:0.0:1788744517.848916:0:6829:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788744517.857446:0:6829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6829:1875634475249280:0@lo:5: 00000100:00100000:0.0:1788744517.857516:0:6829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744517.858453:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475249280 00000100:00100000:1.0:1788744517.858461:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475249280 00000100:00100000:1.0:1788744517.858517:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744517.858528:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6829:x1875634475249280:12345-0@lo:5: 00000100:00100000:0.0:1788744517.858796:0:6829:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220848e40 going to sleep for 11 seconds 00002000:00080000:1.0:1788744517.871768:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788744517.871788:0:6685:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788744517.881190:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6829:x1875634475249280:12345-0@lo:5: Request processed in 22656us (23665us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788744517.881203:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788744517.881246:0:6829:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23c783800 x1875634475249280/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744533 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744517.881262:0:6829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6829:1875634475249280:0@lo:5: 00000004:00080000:1.0:1788744517.881278:0:6829:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788744518.778330:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744519.797896:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744520.820343:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744521.845390:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788744522.128930:0:7051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788744522.549316:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475249408:0@lo:400: 00000100:00100000:0.0:1788744522.549316:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475249792:0@lo:400: 00000100:00100000:3.0:1788744522.549393:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744522.549419:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744522.549454:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475249920:0@lo:13: 00000100:00100000:0.0:1788744522.549459:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475249536:0@lo:400: 00000100:00100000:3.0:1788744522.549488:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744522.549565:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475249408 00000100:00100000:2.0:1788744522.549574:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475249408 00000100:00100000:2.0:1788744522.549627:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788744522.549636:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+16:3308:x1875634475249408:12345-0@lo:400: 00000100:00100000:2.0:1788744522.549692:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+16:3308:x1875634475249408:12345-0@lo:400: Request processed in 57us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744522.549707:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788744522.549753:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475249408:0@lo:400: 00000100:00100000:0.0:1788744522.550107:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744522.550438:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744522.550447:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475249664:0@lo:400: 00000100:00100000:0.0:1788744522.550475:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744522.550657:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475249792 00000100:00100000:0.0:1788744522.550662:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475249792 00000100:00100000:0.0:1788744522.550704:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744522.550712:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875634475249792:12345-0@lo:400: 00000100:00100000:0.0:1788744522.550750:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875634475249792:12345-0@lo:400: Request processed in 40us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744522.550757:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744522.550787:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475249920 00000100:00100000:0.0:1788744522.550791:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475249920 00000100:00100000:0.0:1788744522.550812:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744522.550819:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875634475249920:12345-0@lo:13: 00002000:00000024:0.0:1788744522.550845:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744522.550879:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875634475249920:12345-0@lo:13: Request processed in 61us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744522.550884:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788744522.550897:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788744522.550926:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23c783100 x1875634475249792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744522.550938:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475249792:0@lo:400: 00010000:00080000:0.0:1788744522.550962:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23b4c2d80 x1875634475249920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744522.550981:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475249920:0@lo:13: 00000100:00100000:2.0:1788744522.551263:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475249536 00000100:00100000:2.0:1788744522.551268:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475249536 00000100:00100000:2.0:1788744522.551335:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475249664 00000100:00100000:2.0:1788744522.551339:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475249664 00000100:00100000:2.0:1788744522.551363:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744522.551370:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475249536:12345-0@lo:400: 00000100:00100000:2.0:1788744522.551409:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475249536:12345-0@lo:400: Request processed in 40us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744522.551415:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744522.551427:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744522.551432:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475249664:12345-0@lo:400: 00000100:00100000:2.0:1788744522.551454:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475249664:12345-0@lo:400: Request processed in 23us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744522.551460:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788744522.551642:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788744522.551662:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23c782680 x1875634475249664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744522.551673:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475249664:0@lo:400: 00010000:00080000:0.0:1788744522.551685:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23c782a00 x1875634475249536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744522.551693:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475249536:0@lo:400: 00010000:00010000:0.0:1788744522.871554:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788744523.187296:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788744523.893853:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744524.918781:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744525.941483:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744526.964396:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744527.668457:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744527.668482:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475250048:0@lo:13: 00000100:00100000:2.0:1788744527.668543:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744527.668606:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475250048 00000100:00100000:2.0:1788744527.668614:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475250048 00000100:00100000:2.0:1788744527.668667:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744527.668676:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475250048:12345-0@lo:13: 00002000:00000024:2.0:1788744527.668714:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744527.668764:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475250048:12345-0@lo:13: Request processed in 90us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744527.668770:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788744527.668788:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788744527.668811:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23b4c3100 x1875634475250048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744527.668821:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788744527.668838:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475250048:0@lo:13: 00000100:00100000:0.0:1788744527.679469:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475250304:0@lo:400: 00000100:00100000:0.0:1788744527.679545:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744527.679586:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744527.679592:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475250432:0@lo:400: 00000100:00100000:0.0:1788744527.679632:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744527.679669:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475250304 00000100:00100000:0.0:1788744527.679675:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475250304 00000100:00100000:0.0:1788744527.680259:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475250432 00000100:00100000:0.0:1788744527.680265:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475250432 00000100:00100000:0.0:1788744527.680299:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788744527.680308:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475250304:12345-0@lo:400: 00000100:00100000:0.0:1788744527.681522:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475250304:12345-0@lo:400: Request processed in 1210us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744527.681532:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788744527.681559:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788744527.681576:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475250432:12345-0@lo:400: 00000100:00100000:0.0:1788744527.681608:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475250432:12345-0@lo:400: Request processed in 36us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744527.681613:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788744527.681668:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23c783100 x1875634475250432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744527.681685:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475250432:0@lo:400: 00010000:00080000:0.0:1788744527.681696:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23c782680 x1875634475250304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744527.681703:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475250304:0@lo:400: 00000100:00100000:0.0:1788744527.681731:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744527.681743:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475250176:0@lo:400: 00000100:00100000:0.0:1788744527.681776:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744527.681819:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475250176 00000100:00100000:0.0:1788744527.681825:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475250176 00000100:00100000:0.0:1788744527.681857:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788744527.681864:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+16:3309:x1875634475250176:12345-0@lo:400: 00000100:00100000:0.0:1788744527.681897:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+16:3309:x1875634475250176:12345-0@lo:400: Request processed in 34us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744527.681903:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788744527.681933:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475250176:0@lo:400: 00000100:00080000:0.0:1788744527.681949:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788744527.993397:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744529.023884:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744530.039639:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744531.062486:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744532.092499:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744532.788434:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475250560:0@lo:13: 00000100:00100000:2.0:1788744532.788500:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744532.788570:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475250560 00000100:00100000:2.0:1788744532.788589:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475250560 00000100:00100000:2.0:1788744532.788642:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744532.788651:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475250560:12345-0@lo:13: 00002000:00000024:2.0:1788744532.788685:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744532.788722:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475250560:12345-0@lo:13: Request processed in 73us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744532.788729:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788744532.788752:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788744532.788777:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23b4c3100 x1875634475250560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744532.788795:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475250560:0@lo:13: 00000100:00100000:3.0:1788744532.797193:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744532.797218:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475250688:0@lo:400: 00000100:00100000:3.0:1788744532.797288:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744532.797334:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475250816:0@lo:400: 00000100:00100000:3.0:1788744532.797359:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744532.797380:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744532.797385:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475250944:0@lo:400: 00000100:00100000:3.0:1788744532.797405:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744532.797435:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475250688 00000100:00100000:3.0:1788744532.797452:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475250688 00000100:00100000:3.0:1788744532.797496:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788744532.797505:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+16:3309:x1875634475250688:12345-0@lo:400: 00000100:00100000:3.0:1788744532.797551:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+16:3309:x1875634475250688:12345-0@lo:400: Request processed in 47us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744532.797557:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788744532.797588:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475250816 00000100:00100000:3.0:1788744532.797591:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475250816 00000100:00100000:3.0:1788744532.797614:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475250944 00000100:00100000:3.0:1788744532.797617:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475250944 00000100:00100000:3.0:1788744532.797639:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744532.797645:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475250816:12345-0@lo:400: 00000100:00100000:3.0:1788744532.797677:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475250816:12345-0@lo:400: Request processed in 32us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744532.797682:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744532.797695:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744532.797700:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475250944:12345-0@lo:400: 00000100:00100000:3.0:1788744532.797723:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475250944:12345-0@lo:400: Request processed in 23us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744532.797728:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744532.797764:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475250688:0@lo:400: 00000100:00080000:3.0:1788744532.797788:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788744532.797805:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23d635f80 x1875634475250944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744532.797816:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475250944:0@lo:400: 00010000:00080000:3.0:1788744532.797825:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23d637b80 x1875634475250816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744532.797839:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475250816:0@lo:400: 00010000:00010000:3.0:1788744533.110463:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744534.136316:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744535.159109:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788744535.437242:0:7620:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788744535.437246:0:7620:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788744535.437689:0:7620:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93a104b55800 00000020:01000004:3.0:1788744535.437706:0:7620:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788744535.437719:0:7620:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788744535.437733:0:7620:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93a23d668000) 00000020:00000080:3.0:1788744535.437751:0:7620:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788744535.500028:0:7620:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788744535.501198:0:7620:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788744535.559552:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788744535.575793:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788744535.575828:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788744535.575885:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788744535.575914:0:7620:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788744535.576713:0:7620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788744535.576724:0:7620:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788744535.576733:0:7620:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b162761eb391e05 00000020:01000004:3.0:1788744535.576740:0:7620:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788744535.576760:0:7620:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788744535.576763:0:7620:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788744535.576769:0:7620:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788744535.576790:0:7620:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788744535.576795:0:7620:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788744535.603503:0:7620:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788744535.603549:0:7620:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.106@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788744535.603554:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788744535.603556:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744535.603557:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744535.603558:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744535.603559:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744535.603561:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744535.603563:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744535.603564:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744535.603565:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744535.603567:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744535.603568:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788744535.603572:0:7620:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788744535.603574:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744535.603576:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744535.603577:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744535.603578:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744535.603580:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744535.603581:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744535.603582:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744535.603583:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744535.603584:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744535.603585:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744535.603586:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788744535.603610:0:7620:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788744535.603628:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475251072:0@lo:253: 00000100:00100000:2.0:1788744535.603822:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744535.603935:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23bcb20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744535.611383:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475251072 00000100:00100000:0.0:1788744535.611418:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475251072 00000100:00100000:0.0:1788744535.611479:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788744535.611490:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+16:7620:x1875634475251072:12345-0@lo:253: 20000000:01000000:0.0:1788744535.611537:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788744535.611541:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788744535.611546:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788744535.611549:0:5835:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788744535.614443:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744535.614945:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788744535.614962:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788744535.615022:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788744535.615032:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788744535.615064:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788744535.615114:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788744535.615554:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788744535.615575:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.106@tcp 20000000:01000000:0.0:1788744535.615578:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:0.0:1788744535.615917:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788744535.615926:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788744535.616257:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788744535.616268:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:0.0:1788744535.616303:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788744535.616313:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788744535.616345:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788744535.616398:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788744535.617742:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788744535.617770:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.106@tcp 20000000:01000000:0.0:1788744535.617772:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:0.0:1788744535.617825:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788744535.618158:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788744535.618197:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788744535.618214:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:0.0:1788744535.618248:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788744535.618258:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788744535.618306:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788744535.618345:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788744535.618366:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788744535.618369:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788744535.618374:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788744535.618391:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788744535.618394:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788744535.618433:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788744535.618435:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788744535.620955:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788744535.621073:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788744535.621110:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788744535.621532:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788744535.621577:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788744535.621648:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788744535.621661:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788744535.621665:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788744535.622930:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788744535.622991:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788744535.623061:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788744535.623744:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788744535.623786:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788744535.623821:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788744535.623899:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788744535.623902:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788744535.624469:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788744535.624752:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788744535.624792:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788744535.624960:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788744535.624973:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788744535.624983:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788744535.626350:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788744535.626411:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788744535.626465:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788744535.627452:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788744535.627515:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788744535.627701:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788744535.627721:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788744535.627723:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788744535.627731:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788744535.627751:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93a201472c00/0x4b162761eb391e0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.627768:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a2027e7800/0x4b162761eb391d5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391d56 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.627776:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a238530000/0x4b162761eb391d87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391d80 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.627782:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a201473c00/0x4b162761eb391db1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391daa expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.627788:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a201472600/0x4b162761eb391dcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391dc6 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.627794:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a2027e6400/0x4b162761eb391df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391df0 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.627802:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93a201472c00/0x4b162761eb391e0c lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.627957:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a2027e6400/0x4b162761eb391df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391df0 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.627973:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a2027e6400/0x4b162761eb391df7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391df0 expref: 16 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744535.627994:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1875634475251200:0@lo:104: 00000100:00100000:2.0:1788744535.628074:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744535.628304:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788744535.628319:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475251200 00000100:00100000:0.0:1788744535.628326:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475251200 00000100:00100000:0.0:1788744535.628369:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788744535.628378:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204923050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+3:5835:x1875634475251200:12345-0@lo:104: 00010000:00010000:0.0:1788744535.628391:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a2027e7200/0x4b162761eb391df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391df7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.628452:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788744535.628458:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204923050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+3:5835:x1875634475251200:12345-0@lo:104: Request processed in 81us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744535.628472:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788744535.628603:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744535.628610:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a2027e7200/0x4b162761eb391df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391df7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744535.628618:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e7200 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1788744535.628628:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a2027e7200/0x4b162761eb391df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391df7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744535.628637:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a2027e7200/0x4b162761eb391df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391df7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744535.628644:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a2027e7200/0x4b162761eb391df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391df7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744535.628650:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744535.628688:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a2027e7200/0x4b162761eb391df0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391df7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744535.628695:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744535.628717:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a2027e7200/0x4b162761eb391df0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391df7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744535.628724:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a2027e7200/0x4b162761eb391df0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391df7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744535.628739:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744535.628740:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744535.628742:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744535.628755:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475251328:0@lo:103: 00000100:00100000:1.0:1788744535.628786:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744535.628843:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475251328 00000100:00100000:1.0:1788744535.628848:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475251328 00010000:00010000:1.0:1788744535.628866:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a2027e6400/0x4b162761eb391df7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391df0 expref: 17 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744535.628888:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744535.628901:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+17:3309:x1875634475251328:12345-0@lo:103: 00010000:00010000:1.0:1788744535.628911:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744535.628917:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a2027e6400/0x4b162761eb391df7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391df0 expref: 17 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744535.628926:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a2027e6400/0x4b162761eb391df7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391df0 expref: 17 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744535.628940:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744535.628968:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+17:3309:x1875634475251328:12345-0@lo:103: Request processed in 68us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744535.628974:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744535.629018:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475251328:0@lo:103: 00010000:00010000:2.0:1788744535.629320:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a201472600/0x4b162761eb391dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391dc6 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.629332:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a201472600/0x4b162761eb391dcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391dc6 expref: 16 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744535.629342:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1875634475251456:0@lo:104: 00000100:00100000:2.0:1788744535.629385:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744535.629427:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a201473c00/0x4b162761eb391db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391daa expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.629434:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a201473c00/0x4b162761eb391db1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391daa expref: 16 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744535.629442:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1875634475251584:0@lo:104: 00000100:00100000:2.0:1788744535.629462:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744535.629489:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a238530000/0x4b162761eb391d87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391d80 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.629496:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a238530000/0x4b162761eb391d87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391d80 expref: 16 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744535.629504:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1875634475251712:0@lo:104: 00000100:00100000:2.0:1788744535.629976:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744535.630002:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a2027e7800/0x4b162761eb391d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391d56 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.630033:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a2027e7800/0x4b162761eb391d5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391d56 expref: 16 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744535.630041:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1875634475251840:0@lo:104: 00000100:00100000:2.0:1788744535.630063:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744535.630073:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23bcb2c00 going to sleep for 11 seconds 00010000:00010000:2.0:1788744535.630088:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2027e6400/0x4b162761eb391df7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391df0 expref: 16 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744535.630099:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1875634475251200:0@lo:104: 00000100:00100000:3.0:1788744535.630180:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475251456 00000100:00100000:3.0:1788744535.630186:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475251456 00000100:00100000:3.0:1788744535.630220:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475251584 00000100:00100000:3.0:1788744535.630223:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475251584 00000100:00100000:3.0:1788744535.630231:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475251712 00000100:00100000:3.0:1788744535.630233:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475251712 00000100:00100000:3.0:1788744535.630240:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475251840 00000100:00100000:3.0:1788744535.630242:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475251840 00000100:00100000:3.0:1788744535.630254:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744535.630262:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+6:5835:x1875634475251456:12345-0@lo:104: 00010000:00010000:3.0:1788744535.630273:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a200031e00/0x4b162761eb391dc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391dcd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630328:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788744535.630334:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+6:5835:x1875634475251456:12345-0@lo:104: Request processed in 74us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744535.630341:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744535.630356:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744535.630362:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+5:5835:x1875634475251584:12345-0@lo:104: 00010000:00010000:3.0:1788744535.630369:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a238530400/0x4b162761eb391daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391db1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630396:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788744535.630400:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+5:5835:x1875634475251584:12345-0@lo:104: Request processed in 39us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744535.630405:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744535.630415:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744535.630420:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+4:5835:x1875634475251712:12345-0@lo:104: 00010000:00010000:3.0:1788744535.630427:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391d87 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630461:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788744535.630466:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+4:5835:x1875634475251712:12345-0@lo:104: Request processed in 46us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744535.630471:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744535.630482:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744535.630488:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+3:5835:x1875634475251840:12345-0@lo:104: 00010000:00010000:3.0:1788744535.630495:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391d56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391d5d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630516:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788744535.630521:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+3:5835:x1875634475251840:12345-0@lo:104: Request processed in 35us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744535.630539:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788744535.630554:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788744535.630560:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a200031e00/0x4b162761eb391dc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391dcd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630567:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200031e00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744535.630570:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a200031e00/0x4b162761eb391dc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391dcd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630579:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a200031e00/0x4b162761eb391dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391dcd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744535.630652:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a200031e00/0x4b162761eb391dc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391dcd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744535.630658:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744535.630693:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a200031e00/0x4b162761eb391dc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391dcd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630700:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744535.630717:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a200031e00/0x4b162761eb391dc6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391dcd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630724:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a200031e00/0x4b162761eb391dc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391dcd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630737:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788744535.630740:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a238530400/0x4b162761eb391daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391db1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630746:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238530400 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744535.630749:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a238530400/0x4b162761eb391daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391db1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630755:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a238530400/0x4b162761eb391daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391db1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744535.630762:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a238530400/0x4b162761eb391daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391db1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744535.630768:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744535.630779:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a238530400/0x4b162761eb391daa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391db1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630785:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744535.630799:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a238530400/0x4b162761eb391daa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391db1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630816:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a238530400/0x4b162761eb391daa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391db1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630901:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788744535.630906:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391d87 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630912:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e7a00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744535.630915:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391d87 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630922:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391d87 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744535.630928:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391d87 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744535.630933:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744535.630947:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391d80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391d87 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630953:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744535.630959:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391d80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391d87 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630965:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391d80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391d87 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630974:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744535.630983:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391d56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391d5d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630989:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201473400 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744535.630992:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391d56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391d5d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.630998:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391d5d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744535.631016:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391d5d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744535.631021:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744535.631034:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391d56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391d5d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.631039:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744535.631044:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391d56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391d5d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.631049:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391d56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391d5d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.631064:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744535.631065:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744535.631067:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744535.631080:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475252096:0@lo:103: 00000100:00100000:3.0:1788744535.631108:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744535.631151:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744535.631157:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475252224:0@lo:103: 00000100:00100000:3.0:1788744535.631186:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744535.631214:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475252096 00000100:00100000:3.0:1788744535.631220:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475252096 00010000:00010000:3.0:1788744535.631239:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a201473c00/0x4b162761eb391db1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391daa expref: 16 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744535.631259:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475252224 00000100:00100000:3.0:1788744535.631262:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475252224 00010000:00010000:3.0:1788744535.631273:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a238530000/0x4b162761eb391d87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391d80 expref: 17 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744535.631286:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744535.631292:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754bab6b-7807-4d58-8a45-456ed56af02a+17:3307:x1875634475252096:12345-0@lo:103: 00010000:00010000:3.0:1788744535.631301:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744535.631306:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a201473c00/0x4b162761eb391db1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391daa expref: 17 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.631316:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a201473c00/0x4b162761eb391db1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391daa expref: 17 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.631331:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744535.631359:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754bab6b-7807-4d58-8a45-456ed56af02a+17:3307:x1875634475252096:12345-0@lo:103: Request processed in 68us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744535.631365:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744535.631377:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744535.631383:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754bab6b-7807-4d58-8a45-456ed56af02a+16:3307:x1875634475252224:12345-0@lo:103: 00010000:00010000:3.0:1788744535.631390:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744535.631394:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a238530000/0x4b162761eb391d87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391d80 expref: 16 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.631412:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a238530000/0x4b162761eb391d87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391d80 expref: 16 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.631422:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744535.631442:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754bab6b-7807-4d58-8a45-456ed56af02a+16:3307:x1875634475252224:12345-0@lo:103: Request processed in 60us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744535.631448:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744535.631466:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475251968:0@lo:103: 00000100:00100000:3.0:1788744535.631486:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744535.631501:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744535.631506:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475252352:0@lo:103: 00000100:00100000:3.0:1788744535.631521:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744535.631538:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475251968 00000100:00100000:3.0:1788744535.631541:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475251968 00010000:00010000:3.0:1788744535.631552:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a201472600/0x4b162761eb391dcd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391dc6 expref: 16 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744535.631564:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475252352 00000100:00100000:3.0:1788744535.631566:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475252352 00010000:00010000:3.0:1788744535.631574:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a2027e7800/0x4b162761eb391d5d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391d56 expref: 17 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744535.631779:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1875634475251456:0@lo:104: 00010000:00010000:2.0:1788744535.631790:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a201473c00/0x4b162761eb391db1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391daa expref: 17 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744535.631801:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1875634475251584:0@lo:104: 00010000:00010000:2.0:1788744535.631808:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a238530000/0x4b162761eb391d87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391d80 expref: 16 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744535.631817:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1875634475251712:0@lo:104: 00000100:00100000:2.0:1788744535.631824:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5835:1875634475251840:0@lo:104: 00010000:00010000:0.0:1788744535.631940:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744535.631993:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93a201472c00/0x4b162761eb391e0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744535.632045:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788744535.632053:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+15:3310:x1875634475251968:12345-0@lo:103: 00010000:00010000:2.0:1788744535.632062:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744535.632074:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a201472600/0x4b162761eb391dcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391dc6 expref: 15 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.632082:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a201472600/0x4b162761eb391dcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391dc6 expref: 15 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.632093:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a201472600/0x4b162761eb391dcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391dc6 expref: 15 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.632107:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744535.632170:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+14:3310:x1875634475251968:12345-0@lo:103: Request processed in 118us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744535.632176:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788744535.632190:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788744535.632197:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+13:3310:x1875634475252352:12345-0@lo:103: 00010000:00010000:2.0:1788744535.632204:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744535.632208:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a2027e7800/0x4b162761eb391d5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391d56 expref: 13 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.632216:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a2027e7800/0x4b162761eb391d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391d56 expref: 13 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.632225:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2027e7800/0x4b162761eb391d5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391d56 expref: 13 pid: 5835 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.632235:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93a201472c00/0x4b162761eb391e0c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.632243:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a201472c00/0x4b162761eb391e0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.632268:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a201472c00/0x4b162761eb391e0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.632276:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a201472c00/0x4b162761eb391e0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.632283:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93a201472c00/0x4b162761eb391e0c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.632289:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93a201472c00/0x4b162761eb391e0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.632294:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201472c00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744535.632298:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93a201472c00/0x4b162761eb391e0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.632305:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93a201472c00/0x4b162761eb391e0c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.632319:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93a201472c00/0x4b162761eb391e0c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.632327:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744535.632845:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788744535.632855:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788744535.633494:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93a201472c00/0x4b162761eb391e0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744535.633505:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93a201472c00/0x4b162761eb391e0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744535.633511:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a201472c00/0x4b162761eb391e0c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788744535.633536:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788744535.635654:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475251968:0@lo:103: 00000100:00100000:2.0:1788744535.638317:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+12:3310:x1875634475252352:12345-0@lo:103: Request processed in 6112us (6785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744535.638335:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744535.638488:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475252352:0@lo:103: 00000100:00100000:3.0:1788744535.638624:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475252224:0@lo:103: 00000100:00100000:3.0:1788744535.638636:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475252096:0@lo:103: 00000100:00100000:0.0:1788744535.708435:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+11:7620:x1875634475251072:12345-0@lo:253: Request processed in 96935us (104601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744535.708451:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788744535.708564:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475251072:0@lo:253: 10000000:01000000:2.0:1788744535.708580:0:7620:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788744535.708650:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788744535.708664:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744535.708665:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744535.708667:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788744535.708668:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744535.708669:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744535.708671:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744535.708672:0:7620:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788744535.708674:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744535.708675:0:7620:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788744535.708694:0:7620:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93a104b55800 from lustre-OST0001 10000000:01000000:2.0:1788744535.708720:0:7620:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788744535.708723:0:7620:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788744535.708731:0:7620:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93a207434d40 local copy 10000000:01000000:2.0:1788744535.708735:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788744535.708775:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201472600/0x4b162761eb391e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.708787:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.106@tcp lock: ffff93a201472600/0x4b162761eb391e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.708797:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a201472600/0x4b162761eb391e13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744535.708814:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475252480:0@lo:101: 00000100:00100000:2.0:1788744535.708849:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744535.708948:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23bcb26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744535.709223:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475252480 00000100:00100000:0.0:1788744535.709231:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475252480 00000100:00100000:0.0:1788744535.709368:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788744535.709377:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+11:7620:x1875634475252480:12345-0@lo:101: 00010000:00010000:0.0:1788744535.709391:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744535.709406:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a200030800/0x4b162761eb391e1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391e13 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.709431:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a200030800/0x4b162761eb391e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391e13 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.709441:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a200030800/0x4b162761eb391e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391e13 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.709449:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a200030800, rc 0) 00000100:00100000:0.0:1788744535.709490:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:7620:x1875634475252480:12345-0@lo:101: Request processed in 115us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744535.709495:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788744535.709557:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475252480:0@lo:101: 00010000:00010000:2.0:1788744535.709569:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a201472600/0x4b162761eb391e13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4b162761eb391e1a expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.709577:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a201472600/0x4b162761eb391e13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b162761eb391e1a expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744535.709700:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475252608:0@lo:501: 00000100:00100000:2.0:1788744535.709725:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744535.709887:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23bcb26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744535.709965:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475252608 00000100:00100000:3.0:1788744535.709977:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475252608 00000100:00100000:3.0:1788744535.709999:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788744535.710016:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+12:7620:x1875634475252608:12345-0@lo:501: 00000100:00100000:3.0:1788744535.710241:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+12:7620:x1875634475252608:12345-0@lo:501: Request processed in 225us (514us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744535.710248:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788744535.710380:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475252608:0@lo:501: 10000000:01000000:2.0:1788744535.710392:0:7620:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788744535.710416:0:7620:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788744535.710422:0:7620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201472600/0x4b162761eb391e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b162761eb391e1a expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.710431:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201472600/0x4b162761eb391e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b162761eb391e1a expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.710438:0:7620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff93a201472600/0x4b162761eb391e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b162761eb391e1a expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.710458:0:7620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788744535.710477:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93a104b55800 10000000:01000000:2.0:1788744535.710482:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788744535.710487:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788744535.710489:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788744535.710493:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788744535.710496:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788744535.710513:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201473c00/0x4b162761eb391e21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.710520:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a201473c00/0x4b162761eb391e21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.710537:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a201473c00/0x4b162761eb391e21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744535.710549:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475252736:0@lo:101: 00000100:00100000:2.0:1788744535.710575:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744535.710707:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23bcb2840 going to sleep for 11 seconds 00010000:00010000:3.0:1788744535.710760:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744535.710766:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a201472600/0x4b162761eb391e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4b162761eb391e1a expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.710773:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201472600 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744535.710777:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a201472600/0x4b162761eb391e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4b162761eb391e1a expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.710785:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a201472600/0x4b162761eb391e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4b162761eb391e1a expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744535.710792:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a201472600/0x4b162761eb391e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4b162761eb391e1a expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744535.710799:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744535.710818:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a201472600/0x4b162761eb391e13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b162761eb391e1a expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.710825:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744535.710852:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a201472600/0x4b162761eb391e13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b162761eb391e1a expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.710860:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a201472600/0x4b162761eb391e13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b162761eb391e1a expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.710887:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744535.710889:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744535.710891:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744535.710899:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744535.710910:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475252864:0@lo:103: 00000100:00100000:3.0:1788744535.710937:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744535.710964:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475252864 00000100:00100000:3.0:1788744535.710968:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475252864 00000100:00100000:3.0:1788744535.710998:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744535.711016:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754bab6b-7807-4d58-8a45-456ed56af02a+12:3309:x1875634475252864:12345-0@lo:103: 00010000:00010000:3.0:1788744535.711025:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744535.711037:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a200030800/0x4b162761eb391e1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b162761eb391e13 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.711051:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744535.711078:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754bab6b-7807-4d58-8a45-456ed56af02a+11:3309:x1875634475252864:12345-0@lo:103: Request processed in 74us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744535.711084:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744535.711111:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475252864:0@lo:103: 00000100:00100000:3.0:1788744535.711156:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475252736 00000100:00100000:3.0:1788744535.711160:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475252736 00000100:00100000:3.0:1788744535.711177:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788744535.711183:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:7620:x1875634475252736:12345-0@lo:101: 00010000:00010000:3.0:1788744535.711190:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744535.711200:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a238530400/0x4b162761eb391e28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391e21 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.711228:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a238530400/0x4b162761eb391e28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391e21 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.711237:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a238530400/0x4b162761eb391e28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391e21 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.711243:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a238530400, rc 0) 00000100:00100000:3.0:1788744535.711427:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+12:7620:x1875634475252736:12345-0@lo:101: Request processed in 244us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744535.711433:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788744535.712681:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475252736:0@lo:101: 00010000:00010000:2.0:1788744535.712704:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a201473c00/0x4b162761eb391e21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e28 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.712715:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a201473c00/0x4b162761eb391e21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391e28 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744535.712910:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475252992:0@lo:501: 00000100:00100000:0.0:1788744535.712971:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744535.713043:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204849840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744535.713104:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475252992 00000100:00100000:3.0:1788744535.713111:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475252992 00000100:00100000:3.0:1788744535.713175:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788744535.713185:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+12:7620:x1875634475252992:12345-0@lo:501: 00000100:00100000:3.0:1788744535.713459:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+12:7620:x1875634475252992:12345-0@lo:501: Request processed in 274us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744535.713467:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788744535.713608:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475252992:0@lo:501: 00000100:00100000:2.0:1788744535.713637:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475253120:0@lo:503: 00000100:00100000:2.0:1788744535.713679:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744535.713704:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23bcb2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788744535.713820:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475253120 00000100:00100000:0.0:1788744535.713825:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475253120 00000100:00100000:0.0:1788744535.713846:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788744535.713852:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:7620:x1875634475253120:12345-0@lo:503: 00000100:00100000:0.0:1788744535.714018:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:7620:x1875634475253120:12345-0@lo:503: Request processed in 165us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744535.714024:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788744535.714100:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475253120:0@lo:503: 00000040:00080000:2.0:1788744535.714400:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744535.714480:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475253248:0@lo:502: 00000100:00100000:2.0:1788744535.714519:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744535.714541:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23bcb2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788744535.714707:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475253248 00000100:00100000:0.0:1788744535.714711:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475253248 00000100:00100000:0.0:1788744535.714732:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788744535.714738:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:7620:x1875634475253248:12345-0@lo:502: 00000100:00100000:0.0:1788744535.714879:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:7620:x1875634475253248:12345-0@lo:502: Request processed in 141us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744535.714886:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788744535.715792:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475253248:0@lo:502: 00000040:00080000:2.0:1788744535.716104:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788744535.716194:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788744535.716238:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788744535.716363:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788744535.716402:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788744535.716437:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788744535.716468:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475253376:0@lo:502: 00000100:00100000:2.0:1788744535.716527:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744535.716677:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23bcb2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788744535.717964:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475253376 00000100:00100000:0.0:1788744535.717976:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475253376 00000100:00100000:0.0:1788744535.718046:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788744535.718057:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:7620:x1875634475253376:12345-0@lo:502: 00000100:00100000:0.0:1788744535.718742:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:7620:x1875634475253376:12345-0@lo:502: Request processed in 684us (2212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744535.718751:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788744535.719110:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475253376:0@lo:502: 00000040:00080000:2.0:1788744535.719474:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788744535.719487:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788744535.720342:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788744535.720351:0:7628:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788744535.720357:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744535.720359:0:7628:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788744535.720365:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788744535.720385:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93a2064c19c0) 00000020:00000080:0.0:1788744535.720407:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788744535.720412:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788744535.720475:0:7628:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93a104b55800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788744535.720484:0:7628:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788744535.720503:0:7628:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b162761eb391e36 00010000:00010000:0.0:1788744535.724801:0:7628:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788744535.725176:0:7628:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788744535.728209:0:7628:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788744535.730091:0:7628:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788744535.735822:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788744535.736425:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788744535.740475:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788744535.740490:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744535.740497:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744535.740499:0:7628:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788744535.740506:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744535.740509:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744535.740511:0:7628:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788744535.740514:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788744535.740516:0:7628:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788744535.740579:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744535.740816:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744535.740818:0:7628:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788744535.740823:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788744535.741043:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788744535.741066:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788744535.741088:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201473c00/0x4b162761eb391e21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e28 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.741101:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a201473c00/0x4b162761eb391e21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e28 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744535.741108:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a104b55800 from 1 10000000:01000000:2.0:1788744535.741111:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744535.741184:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201473600/0x4b162761eb391e3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.741193:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a201473600/0x4b162761eb391e3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.741204:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a201473600/0x4b162761eb391e3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744535.741226:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475253504:0@lo:101: 00000100:00100000:2.0:1788744535.741313:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744535.741349:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23bcb2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744535.741521:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475253504 00000100:00100000:0.0:1788744535.741528:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475253504 00000100:00100000:0.0:1788744535.741570:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788744535.741580:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:7620:x1875634475253504:12345-0@lo:101: 00010000:00010000:0.0:1788744535.741706:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744535.741719:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a200030800/0x4b162761eb391e44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391e3d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.741756:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a200030800/0x4b162761eb391e44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391e3d expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.741766:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a200030800/0x4b162761eb391e44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391e3d expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.741775:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a200030800, rc 0) 00000100:00100000:0.0:1788744535.741827:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:7620:x1875634475253504:12345-0@lo:101: Request processed in 248us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744535.741834:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788744535.741911:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475253504:0@lo:101: 00010000:00010000:2.0:1788744535.741925:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a201473600/0x4b162761eb391e3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e44 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.741934:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a201473600/0x4b162761eb391e3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391e44 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744535.742045:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475253632:0@lo:501: 00000100:00100000:2.0:1788744535.742071:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744535.742150:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23bcb2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744535.748467:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475253632 00000100:00100000:0.0:1788744535.748488:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475253632 00000100:00100000:0.0:1788744535.748559:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788744535.748570:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+13:7620:x1875634475253632:12345-0@lo:501: 00000100:00100000:0.0:1788744535.748947:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+13:7620:x1875634475253632:12345-0@lo:501: Request processed in 378us (6874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744535.748955:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788744535.754801:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475253632:0@lo:501: 00000100:00100000:3.0:1788744535.754886:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475253760:0@lo:503: 00000100:00100000:3.0:1788744535.754992:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744535.755797:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20d114900 going to sleep for 11 seconds 00000100:00100000:0.0:1788744535.759440:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475253760 00000100:00100000:0.0:1788744535.759457:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475253760 00000100:00100000:0.0:1788744535.759887:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788744535.759936:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:7620:x1875634475253760:12345-0@lo:503: 00000100:00100000:1.0:1788744535.760390:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:7620:x1875634475253760:12345-0@lo:503: Request processed in 493us (5397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744535.760927:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475253760:0@lo:503: 00000040:00080000:2.0:1788744535.761367:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744535.761440:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475253888:0@lo:502: 00000100:00100000:2.0:1788744535.761492:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744535.761538:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23bcb29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744535.761796:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475253888 00000100:00100000:0.0:1788744535.761803:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475253888 00000100:00100000:1.0:1788744535.762715:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788744535.762900:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788744535.762913:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+13:7620:x1875634475253888:12345-0@lo:502: 00000100:00100000:0.0:1788744535.763790:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+13:7620:x1875634475253888:12345-0@lo:502: Request processed in 878us (2295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744535.763799:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788744535.763936:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475253888:0@lo:502: 00000040:00080000:2.0:1788744535.764276:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788744535.764332:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788744535.764370:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475254016:0@lo:502: 00000100:00100000:2.0:1788744535.764414:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744535.764451:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23bcb29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744535.764622:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475254016 00000100:00100000:1.0:1788744535.764629:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475254016 00000100:00100000:1.0:1788744535.764671:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788744535.764679:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:7620:x1875634475254016:12345-0@lo:502: 00000100:00100000:1.0:1788744535.764846:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:7620:x1875634475254016:12345-0@lo:502: Request processed in 167us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744535.764853:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788744535.764983:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475254016:0@lo:502: 00000040:00080000:2.0:1788744535.765072:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788744535.765083:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788744535.766577:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744535.766702:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744535.766704:0:7632:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788744535.766712:0:7632:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93a104b55800 00000020:00000080:1.0:1788744535.766715:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788744535.766738:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744535.766742:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744535.766743:0:7632:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788744535.766746:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788744535.769477:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788744535.769527:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788744535.769547:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201473600/0x4b162761eb391e3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e44 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.769591:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a201473600/0x4b162761eb391e3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e44 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744535.769647:0:7620:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788744535.769650:0:7620:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93a104b55800 10000000:01000000:3.0:1788744535.769653:0:7620:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93a104b55800 10000000:01000000:3.0:1788744535.769656:0:7620:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744535.769662:0:7620:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93a104b55800 from 1 10000000:01000000:3.0:1788744535.769665:0:7620:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788744535.769704:0:7620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a238530c00/0x4b162761eb391e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.769711:0:7620:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a238530c00/0x4b162761eb391e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.769723:0:7620:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a238530c00/0x4b162761eb391e4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744535.769745:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475254144:0@lo:101: 00000100:00100000:3.0:1788744535.769820:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744535.769867:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207e43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744535.769997:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475254144 00000100:00100000:0.0:1788744535.770013:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475254144 00000100:00100000:0.0:1788744535.770068:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788744535.770078:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+13:7620:x1875634475254144:12345-0@lo:101: 00010000:00010000:0.0:1788744535.770093:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744535.770107:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a200031e00/0x4b162761eb391e52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391e4b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.770165:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a200031e00/0x4b162761eb391e52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391e4b expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.770176:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a200031e00/0x4b162761eb391e52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391e4b expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.770184:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a200031e00, rc 0) 00000100:00100000:0.0:1788744535.770227:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+14:7620:x1875634475254144:12345-0@lo:101: Request processed in 150us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744535.770234:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788744535.770497:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475254144:0@lo:101: 00010000:00010000:3.0:1788744535.770511:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a238530c00/0x4b162761eb391e4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e52 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744535.770520:0:7620:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a238530c00/0x4b162761eb391e4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391e52 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744535.770686:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475254272:0@lo:501: 00000100:00100000:3.0:1788744535.770711:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744535.770776:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207e43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744535.771531:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475254272 00000100:00100000:2.0:1788744535.771538:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475254272 00000100:00100000:1.0:1788744535.771630:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788744535.771639:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20791e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+14:7620:x1875634475254272:12345-0@lo:501: 00000100:00100000:1.0:1788744535.771866:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20791e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+14:7620:x1875634475254272:12345-0@lo:501: Request processed in 227us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744535.771873:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788744535.772154:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475254272:0@lo:501: 00000100:00100000:3.0:1788744535.772186:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475254400:0@lo:503: 00000100:00100000:3.0:1788744535.772222:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744535.772241:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207e43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744535.772339:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475254400 00000100:00100000:2.0:1788744535.772343:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475254400 00000100:00100000:2.0:1788744535.772367:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788744535.772373:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20791e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+14:7620:x1875634475254400:12345-0@lo:503: 00000100:00100000:2.0:1788744535.772507:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20791e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+14:7620:x1875634475254400:12345-0@lo:503: Request processed in 133us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744535.772513:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788744535.774936:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475254400:0@lo:503: 00000040:00080000:3.0:1788744535.775441:0:7620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788744535.775659:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475254528:0@lo:502: 00000100:00100000:3.0:1788744535.775730:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744535.775770:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207e43a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744535.776245:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475254528 00000100:00100000:2.0:1788744535.776263:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475254528 00000100:00100000:2.0:1788744535.776314:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788744535.776323:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20791dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+14:7620:x1875634475254528:12345-0@lo:502: 00000100:00100000:2.0:1788744535.776848:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20791dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+14:7620:x1875634475254528:12345-0@lo:502: Request processed in 524us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744535.776856:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788744535.777796:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475254528:0@lo:502: 00000040:00080000:3.0:1788744535.778743:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788744535.778808:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788744535.778837:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788744535.778883:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788744535.778936:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788744535.778984:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788744535.779031:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788744535.779064:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788744535.779119:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788744535.779176:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788744535.779801:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788744535.779891:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788744535.779924:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788744535.779966:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788744535.780026:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788744535.780064:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788744535.780095:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788744535.780160:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788744535.780194:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788744535.780236:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788744535.780379:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788744535.780413:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788744535.780438:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788744535.780478:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788744535.780511:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788744535.780557:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788744535.780802:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788744535.780840:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788744535.780873:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788744535.780919:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788744535.780953:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788744535.780984:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788744535.781033:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788744535.781079:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788744535.781113:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788744535.781182:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788744535.781233:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788744535.781695:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475254656:0@lo:502: 00000100:00100000:3.0:1788744535.781773:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744535.781858:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207e43a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744535.784245:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475254656 00000100:00100000:1.0:1788744535.784271:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475254656 00000100:00100000:1.0:1788744535.784344:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788744535.784354:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20791cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+14:7620:x1875634475254656:12345-0@lo:502: 00000100:00100000:1.0:1788744535.785053:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20791cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+14:7620:x1875634475254656:12345-0@lo:502: Request processed in 698us (3276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744535.785062:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788744535.785238:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475254656:0@lo:502: 00000040:00080000:3.0:1788744535.785367:0:7620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788744535.785383:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788744535.786454:0:7633:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788744535.786481:0:7633:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93a23d6699c0) 00000020:00000080:3.0:1788744535.786505:0:7633:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788744535.786716:0:7633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93a104b55800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788744535.786720:0:7633:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93a104b55800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788744535.786722:0:7633:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93a104b55800 3 00010000:00080000:3.0:1788744535.786751:0:7633:0:(ldlm_lib.c:103:import_set_conn()) imp ffff93a23f851000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.106@tcp at head 00010000:00010000:0.0:1788744535.789920:0:7633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1788744535.790408:0:7633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788744535.790450:0:7633:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788744535.790466:0:7633:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4b162761eb391e60 00000100:00080000:0.0:1788744535.790477:0:7633:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788744535.790490:0:7633:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93a23f851000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788744535.790668:0:7633:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23ccbb800 x1875634475254784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788744535.790695:0:7633:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788744535.790760:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875634475254784:0@lo:38: 00000100:00100000:2.0:1788744535.790823:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788744535.791374:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788744535.791430:0:7620:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788744535.791457:0:7620:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788744535.791475:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a238530c00/0x4b162761eb391e4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e52 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744535.791486:0:7620:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a238530c00/0x4b162761eb391e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e52 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788744535.791556:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788744535.791561:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744535.791563:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744535.791564:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744535.791565:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744535.791566:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744535.791568:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744535.791569:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744535.791571:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744535.791573:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744535.791574:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744535.791579:0:7620:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788744535.791591:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744535.791592:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744535.791593:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744535.791593:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744535.791594:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744535.791595:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744535.791596:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744535.791597:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744535.791598:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744535.791599:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744535.791600:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744535.791621:0:7620:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788744535.791633:0:7620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475254912:0@lo:253: 00000100:00100000:2.0:1788744535.791678:0:7620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744535.791696:0:7620:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23bcb2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744535.791717:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475254912 00000100:00100000:2.0:1788744535.791724:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475254912 00000100:00100000:2.0:1788744535.791765:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788744535.791774:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+14:7620:x1875634475254912:12345-0@lo:253: 20000000:01000000:2.0:1788744535.791799:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788744535.791813:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1788744535.794381:0:7634:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff93a23ccb8a80 x1875634475255040/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744535.794413:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2147b5cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1788744535.795820:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744535.795842:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475255424:0@lo:400: 00000100:00100000:1.0:1788744535.795923:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744535.795979:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475255424 00000100:00100000:1.0:1788744535.795987:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475255424 00000100:00100000:1.0:1788744535.796054:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744535.796064:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475255424:12345-0@lo:400: 00000100:00100000:1.0:1788744535.796118:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475255424:12345-0@lo:400: Request processed in 56us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744535.796126:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788744535.796184:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a220a57800 x1875634475255424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744535.796198:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475255424:0@lo:400: 00000100:00100000:0.0:1788744535.801266:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475255168:0@lo:400: 00000100:00100000:0.0:1788744535.801360:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744535.801417:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744535.801426:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475255296:0@lo:400: 00000100:00100000:0.0:1788744535.801449:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744535.801505:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475254784 00000100:00100000:0.0:1788744535.801516:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475254784 00000100:00100000:0.0:1788744535.801547:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475255168 00000100:00100000:0.0:1788744535.801550:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475255168 00000100:00100000:0.0:1788744535.801594:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475255296 00000100:00100000:0.0:1788744535.801598:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475255296 00000100:00100000:0.0:1788744535.801625:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744535.801635:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475255168:12345-0@lo:400: 00000100:00100000:0.0:1788744535.801692:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475255168:12345-0@lo:400: Request processed in 59us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744535.801699:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744535.801717:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788744535.801724:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475255296:12345-0@lo:400: 00000100:00100000:0.0:1788744535.801752:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475255296:12345-0@lo:400: Request processed in 29us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744535.801758:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788744535.801771:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744535.801776:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875634475254784:12345-0@lo:38: 00010000:00080000:0.0:1788744535.801801:0:5840:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:0.0:1788744535.801842:0:5840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4b162761eb391e67 00000004:00100000:0.0:1788744535.801870:0:5840:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788744535.801906:0:5840:0:(import.c:65:import_set_state_nolock()) ffff93a23c0c3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744535.801948:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875634475254784:12345-0@lo:38: Request processed in 170us (11124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744535.801954:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788744535.801990:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a220a55c00 x1875634475255296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744535.802015:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475255296:0@lo:400: 00010000:00080000:0.0:1788744535.802026:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a220a56300 x1875634475255168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744535.802034:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475255168:0@lo:400: 00000100:00080000:3.0:1788744535.802501:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744535.802507:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788744535.803425:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23ccbb800 x1875634475254784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744535.803437:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788744535.803446:0:3306:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788744535.803461:0:3306:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788744535.803466:0:3306:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788744535.803470:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a23f851000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788744535.803477:0:3306:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ed698662): req@ffff93a23ccb8a80 x1875634475255040/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744535.803492:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875634475254784:0@lo:38: 00000100:00100000:0.0:1788744535.806462:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744535.806504:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2147b5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744535.806840:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475255040 00000100:00100000:1.0:1788744535.806852:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475255040 00000100:00100000:1.0:1788744535.806931:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744535.806943:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7634:x1875634475255040:12345-0@lo:901: 00000100:00080000:3.0:1788744535.807370:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744535.808955:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7634:x1875634475255040:12345-0@lo:901: Request processed in 2005us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744535.808969:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788744535.811458:0:7634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23ccb8a80 x1875634475255040/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788744551 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744535.811478:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccb8a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7634:1875634475255040:0@lo:901: 20000000:01000000:2.0:1788744535.832430:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788744535.832451:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788744535.834562:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788744535.834571:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788744535.834637:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93a200031a00/0x4b162761eb391e6e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.834652:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a238530a00/0x4b162761eb391dbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391db8 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.834658:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93a200031a00/0x4b162761eb391e6e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.834690:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a238530a00/0x4b162761eb391dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391db8 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.834714:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a238530a00/0x4b162761eb391dbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391db8 expref: 14 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744535.834726:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccb8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875634475255552:0@lo:104: 00000100:00100000:0.0:1788744535.834780:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744535.835274:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23bcb2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788744535.836886:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475255552 00000100:00100000:1.0:1788744535.836902:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475255552 00000100:00100000:1.0:1788744535.836957:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744535.836967:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+3:5856:x1875634475255552:12345-0@lo:104: 00010000:00010000:1.0:1788744535.836985:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391dbf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744535.837082:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788744535.837089:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+3:5856:x1875634475255552:12345-0@lo:104: Request processed in 124us (2307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744535.837104:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788744535.837293:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744535.837301:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391dbf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.837310:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200030000 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1788744535.837314:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391dbf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.837323:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391dbf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744535.837330:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391dbf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744535.837336:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744535.837371:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391db8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391dbf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.837378:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744535.837395:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391db8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391dbf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.837401:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391db8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391dbf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.837423:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744535.837425:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744535.837427:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744535.837447:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475255680:0@lo:103: 00000100:00100000:0.0:1788744535.837486:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744535.837534:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475255680 00000100:00100000:0.0:1788744535.837539:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475255680 00010000:00010000:0.0:1788744535.837558:0:7626:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a238530a00/0x4b162761eb391dbf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391db8 expref: 15 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744535.837709:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744535.837718:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202e0a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:754bab6b-7807-4d58-8a45-456ed56af02a+15:3310:x1875634475255680:12345-0@lo:103: 00010000:00010000:0.0:1788744535.837731:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744535.837737:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a238530a00/0x4b162761eb391dbf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391db8 expref: 15 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.837749:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a238530a00/0x4b162761eb391dbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391db8 expref: 15 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.837766:0:7626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93a200031a00/0x4b162761eb391e6e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.837774:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a200031a00/0x4b162761eb391e6e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788744535.837790:0:7626:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003219826s 00010000:00010000:0.0:1788744535.837795:0:7626:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a200031a00/0x4b162761eb391e6e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.837813:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a200031a00/0x4b162761eb391e6e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.837819:0:7626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93a200031a00/0x4b162761eb391e6e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.837826:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93a200031a00/0x4b162761eb391e6e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.837831:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200031a00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744535.837835:0:7626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93a200031a00/0x4b162761eb391e6e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.837843:0:7626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93a200031a00/0x4b162761eb391e6e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.837851:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93a200031a00/0x4b162761eb391e6e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.837861:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744535.837893:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202e0a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:754bab6b-7807-4d58-8a45-456ed56af02a+15:3310:x1875634475255680:12345-0@lo:103: Request processed in 176us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744535.837900:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744535.837960:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475255680:0@lo:103: 00010000:00010000:0.0:1788744535.837989:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a238530a00/0x4b162761eb391dbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391db8 expref: 14 pid: 5834 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744535.838010:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccb8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1875634475255552:0@lo:104: 00010000:00010000:0.0:1788744535.838021:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93a200031a00/0x4b162761eb391e6e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.838036:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93a200031a00/0x4b162761eb391e6e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.838042:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93a200031a00/0x4b162761eb391e6e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744535.838049:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a200031a00/0x4b162761eb391e6e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744535.840928:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+13:7620:x1875634475254912:12345-0@lo:253: Request processed in 49146us (49239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744535.840941:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788744535.841030:0:7620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:754bab6b-7807-4d58-8a45-456ed56af02a:7620:1875634475254912:0@lo:253: 10000000:01000000:0.0:1788744535.841046:0:7620:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788744535.841049:0:7620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788744535.841051:0:7620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788744535.841052:0:7620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744535.841054:0:7620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744535.841056:0:7620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744535.841058:0:7620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744535.841059:0:7620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788744535.841061:0:7620:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788744535.841063:0:7620:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788744535.841064:0:7620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744535.841066:0:7620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788744535.841084:0:7620:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788744535.850846:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744535.851073:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744535.851530:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744535.852375:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744535.852691:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744535.852973:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788744535.858082:0:7620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788744536.117623:0:7620:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788744536.117631:0:7620:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788744536.118980:0:7620:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788744536.119063:0:7620:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788744536.119096:0:7620:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788744536.119123:0:7620:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788744536.182385:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744537.216588:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744537.919422:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475255808:0@lo:13: 00000100:00100000:0.0:1788744537.919495:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744537.921317:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475255808 00000100:00100000:1.0:1788744537.921330:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475255808 00000100:00100000:1.0:1788744537.921408:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744537.921419:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475255808:12345-0@lo:13: 00002000:00000024:1.0:1788744537.921459:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744537.921556:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475255808:12345-0@lo:13: Request processed in 139us (2060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744537.921563:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788744537.921641:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788744537.922930:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a220a57800 x1875634475255808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744537.922957:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475255808:0@lo:13: 00010000:00010000:0.0:1788744538.228689:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744539.252386:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744540.278277:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744540.991846:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475255936:0@lo:400: 00000100:00100000:2.0:1788744540.991993:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744540.992046:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475256448:0@lo:400: 00000100:00100000:2.0:1788744540.992075:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744540.992102:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744540.992108:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475256320:0@lo:400: 00000100:00100000:2.0:1788744540.992145:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744540.992235:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475256064:0@lo:400: 00000100:00100000:2.0:1788744540.992258:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744540.992280:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744540.992286:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475256192:0@lo:400: 00000100:00100000:2.0:1788744540.992318:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744540.992352:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475256448 00000100:00100000:2.0:1788744540.992360:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475256448 00000100:00100000:2.0:1788744540.992403:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475256064 00000100:00100000:2.0:1788744540.992412:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475256064 00000100:00100000:2.0:1788744540.992427:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475256192 00000100:00100000:2.0:1788744540.992430:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475256192 00000100:00100000:2.0:1788744540.992444:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744540.992452:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475256448:12345-0@lo:400: 00000100:00100000:2.0:1788744540.992504:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475256448:12345-0@lo:400: Request processed in 53us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744540.992511:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744540.992532:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788744540.992538:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475256064:12345-0@lo:400: 00000100:00100000:2.0:1788744540.992567:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475256064:12345-0@lo:400: Request processed in 29us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744540.992572:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788744540.992583:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744540.992589:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475256192:12345-0@lo:400: 00000100:00100000:2.0:1788744540.992614:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475256192:12345-0@lo:400: Request processed in 26us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744540.992619:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744540.992635:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475256320 00000100:00100000:2.0:1788744540.992638:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475256320 00000100:00100000:2.0:1788744540.992663:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744540.992669:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475256320:12345-0@lo:400: 00000100:00100000:2.0:1788744540.992696:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475256320:12345-0@lo:400: Request processed in 27us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744540.992701:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788744540.992715:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744540.992719:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788744540.992745:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23b4c1500 x1875634475256192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744540.992766:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475256192:0@lo:400: 00010000:00080000:2.0:1788744540.992779:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23b4c0380 x1875634475256064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744540.992787:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475256064:0@lo:400: 00010000:00080000:2.0:1788744540.992817:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23b4c1880 x1875634475256320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744540.992825:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475256320:0@lo:400: 00010000:00080000:2.0:1788744540.992834:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23b4c2300 x1875634475256448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744540.992841:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475256448:0@lo:400: 00000100:00100000:1.0:1788744541.000307:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475255936 00000100:00100000:1.0:1788744541.000325:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475255936 00000100:00100000:1.0:1788744541.000379:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788744541.000387:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+13:3308:x1875634475255936:12345-0@lo:400: 00000100:00100000:1.0:1788744541.001097:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+13:3308:x1875634475255936:12345-0@lo:400: Request processed in 707us (9101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744541.001106:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788744541.005337:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475255936:0@lo:400: 00010000:00010000:0.0:1788744541.303985:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788744542.004315:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788744542.004323:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93a210e7e800 from 30 10000000:01000000:0.0:1788744542.004328:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788744542.004377:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744542.004389:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744542.004400:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391e75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744542.004423:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccb9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475256576:0@lo:101: 00000100:00100000:0.0:1788744542.004490:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744542.004540:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20d77ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744542.006191:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475256576 00000100:00100000:2.0:1788744542.006205:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475256576 00000100:00100000:2.0:1788744542.006260:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788744542.006270:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+13:5837:x1875634475256576:12345-0@lo:101: 00010000:00010000:2.0:1788744542.006285:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744542.006302:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a201473000/0x4b162761eb391e7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391e75 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744542.006329:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a201473000/0x4b162761eb391e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391e75 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744542.006339:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a201473000/0x4b162761eb391e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391e75 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744542.006364:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a201473000, rc 0) 00000100:00100000:2.0:1788744542.006430:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+14:5837:x1875634475256576:12345-0@lo:101: Request processed in 162us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744542.006437:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788744542.006509:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccb9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475256576:0@lo:101: 00010000:00010000:2.0:1788744542.006527:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391e75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e7c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744542.006536:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391e75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391e7c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744542.006607:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475256704:0@lo:501: 00000100:00100000:2.0:1788744542.006636:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744542.006678:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23ccd6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788744542.006692:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475256704 00000100:00100000:2.0:1788744542.006695:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475256704 00000100:00100000:2.0:1788744542.006714:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788744542.006720:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+14:5837:x1875634475256704:12345-0@lo:501: 00000100:00100000:2.0:1788744542.007521:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+14:5837:x1875634475256704:12345-0@lo:501: Request processed in 798us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744542.007532:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788744542.008451:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475256704:0@lo:501: 00000100:00100000:0.0:1788744542.008497:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475256832:0@lo:503: 00000100:00100000:0.0:1788744542.008558:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744542.008600:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20d77ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744542.008656:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475256832 00000100:00100000:2.0:1788744542.008672:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475256832 00000100:00100000:2.0:1788744542.008716:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788744542.008723:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+14:5837:x1875634475256832:12345-0@lo:503: 00000100:00100000:2.0:1788744542.009275:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+14:5837:x1875634475256832:12345-0@lo:503: Request processed in 550us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744542.009290:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788744542.009448:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475256832:0@lo:503: 00000100:00100000:0.0:1788744542.010251:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:7918:1875634475256960:0@lo:502: 00000100:00100000:0.0:1788744542.010302:0:7918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744542.010330:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20d77ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744542.010386:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475256960 00000100:00100000:2.0:1788744542.010392:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475256960 00000100:00100000:2.0:1788744542.010431:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788744542.010440:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+14:7918:x1875634475256960:12345-0@lo:502: 00000100:00100000:2.0:1788744542.011000:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+14:7918:x1875634475256960:12345-0@lo:502: Request processed in 560us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744542.011009:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788744542.011415:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:7918:1875634475256960:0@lo:502: 00000100:00100000:0.0:1788744542.011470:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:7918:1875634475257088:0@lo:502: 00000100:00100000:0.0:1788744542.011512:0:7918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744542.011588:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744542.011749:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475257088 00000100:00100000:2.0:1788744542.011755:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475257088 00000100:00100000:2.0:1788744542.011800:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788744542.011810:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+14:7918:x1875634475257088:12345-0@lo:502: 00000100:00100000:2.0:1788744542.012579:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+14:7918:x1875634475257088:12345-0@lo:502: Request processed in 761us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744542.012589:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788744542.012934:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:7918:1875634475257088:0@lo:502: 00000040:00080000:0.0:1788744542.012971:0:7918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788744542.013248:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788744542.013271:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788744542.013285:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391e75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e7c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.013298:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e7c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744542.013309:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788744542.013313:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788744542.013317:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788744542.013353:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a238531600/0x4b162761eb391e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.013362:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a238531600/0x4b162761eb391e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.013372:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a238531600/0x4b162761eb391e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744542.013390:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475257216:0@lo:101: 00000100:00100000:3.0:1788744542.013432:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744542.013477:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207fd6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744542.013493:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475257216 00000100:00100000:3.0:1788744542.013498:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475257216 00000100:00100000:3.0:1788744542.013535:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788744542.013543:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+14:5837:x1875634475257216:12345-0@lo:101: 00010000:00010000:3.0:1788744542.013555:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744542.013567:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a238531400/0x4b162761eb391e8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391e83 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.013589:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a238531400/0x4b162761eb391e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391e83 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.013600:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a238531400/0x4b162761eb391e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391e83 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.013607:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a238531400, rc 0) 00000100:00100000:3.0:1788744542.013640:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475257216:12345-0@lo:101: Request processed in 98us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744542.013645:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788744542.013689:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475257216:0@lo:101: 00010000:00010000:3.0:1788744542.013701:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a238531600/0x4b162761eb391e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e8a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.013709:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a238531600/0x4b162761eb391e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391e8a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744542.013757:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475257344:0@lo:501: 00000100:00100000:3.0:1788744542.013781:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744542.013796:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207fd6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744542.013815:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475257344 00000100:00100000:3.0:1788744542.013960:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475257344 00000100:00100000:3.0:1788744542.013987:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788744542.013994:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475257344:12345-0@lo:501: 00000100:00100000:3.0:1788744542.014339:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475257344:12345-0@lo:501: Request processed in 344us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744542.014346:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788744542.014379:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475257344:0@lo:501: 00000100:00100000:3.0:1788744542.014405:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475257472:0@lo:503: 00000100:00100000:3.0:1788744542.014445:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744542.014464:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207fd6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744542.014475:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475257472 00000100:00100000:3.0:1788744542.014479:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475257472 00000100:00100000:3.0:1788744542.014495:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788744542.014502:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475257472:12345-0@lo:503: 00000100:00100000:0.0:1788744542.016344:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475257472:0@lo:503: 00000100:00100000:0.0:1788744542.016555:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:7919:1875634475257600:0@lo:502: 00000100:00100000:0.0:1788744542.025869:0:7919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744542.026376:0:7919:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744542.034299:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475257472:12345-0@lo:503: Request processed in 19784us (19840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744542.034314:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788744542.034382:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475257600 00000100:00100000:3.0:1788744542.034391:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475257600 00000100:00100000:3.0:1788744542.034425:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788744542.034434:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+15:7919:x1875634475257600:12345-0@lo:502: 00000100:00100000:3.0:1788744542.035308:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+15:7919:x1875634475257600:12345-0@lo:502: Request processed in 871us (9444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744542.035317:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788744542.035472:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:7919:1875634475257600:0@lo:502: 00000020:01000000:0.0:1788744542.035509:0:7919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744542.035520:0:7919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744542.035522:0:7919:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788744542.035528:0:7919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788744542.035530:0:7919:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788744542.035565:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:7919:1875634475257728:0@lo:502: 00000100:00100000:0.0:1788744542.035612:0:7919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744542.035656:0:7919:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744542.036071:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475257728 00000100:00100000:3.0:1788744542.036078:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475257728 00000100:00100000:3.0:1788744542.036168:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788744542.036177:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+15:7919:x1875634475257728:12345-0@lo:502: 00000100:00100000:3.0:1788744542.036509:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+15:7919:x1875634475257728:12345-0@lo:502: Request processed in 332us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744542.036515:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788744542.039445:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:7919:1875634475257728:0@lo:502: 00000020:01000000:0.0:1788744542.039499:0:7919:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744542.039509:0:7919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744542.039512:0:7919:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788744542.039516:0:7919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1788744542.039594:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788744542.039613:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788744542.039624:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a238531600/0x4b162761eb391e83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e8a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744542.039636:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a238531600/0x4b162761eb391e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e8a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744542.039647:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788744542.039650:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93a203f6f000 from 30 10000000:01000000:0.0:1788744542.039653:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788744542.039702:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a200031a00/0x4b162761eb391e91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744542.039710:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a200031a00/0x4b162761eb391e91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744542.039719:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a200031a00/0x4b162761eb391e91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744542.039739:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475257856:0@lo:101: 00000100:00100000:0.0:1788744542.039804:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744542.039851:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744542.040050:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475257856 00000100:00100000:3.0:1788744542.040058:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475257856 00000100:00100000:3.0:1788744542.040417:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788744542.040428:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475257856:12345-0@lo:101: 00010000:00010000:3.0:1788744542.040444:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744542.040457:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a238531800/0x4b162761eb391e98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391e91 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.040482:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a238531800/0x4b162761eb391e98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391e91 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.040492:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a238531800/0x4b162761eb391e98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391e91 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.040501:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a238531800, rc 0) 00000100:00100000:3.0:1788744542.040551:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475257856:12345-0@lo:101: Request processed in 126us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744542.040558:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788744542.044048:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475257856:0@lo:101: 00010000:00010000:3.0:1788744542.044085:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a200031a00/0x4b162761eb391e91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e98 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.044100:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a200031a00/0x4b162761eb391e91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391e98 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744542.044521:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475257984:0@lo:501: 00000100:00100000:3.0:1788744542.044589:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744542.044636:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207fd6540 going to sleep for 11 seconds 00000100:00100000:0.0:1788744542.044742:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475257984 00000100:00100000:0.0:1788744542.044749:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475257984 00000100:00100000:0.0:1788744542.044813:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788744542.044823:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475257984:12345-0@lo:501: 00000100:00100000:0.0:1788744542.045550:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475257984:12345-0@lo:501: Request processed in 726us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744542.045559:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788744542.049858:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475257984:0@lo:501: 00000100:00100000:0.0:1788744542.050200:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475258112:0@lo:503: 00000100:00100000:0.0:1788744542.050313:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744542.050364:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744542.051447:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475258112 00000100:00100000:3.0:1788744542.051458:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475258112 00000100:00100000:3.0:1788744542.051529:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788744542.051541:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475258112:12345-0@lo:503: 00000100:00100000:3.0:1788744542.051794:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475258112:12345-0@lo:503: Request processed in 255us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744542.051802:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788744542.053058:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475258112:0@lo:503: 00000100:00100000:2.0:1788744542.054453:0:7920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:7920:1875634475258240:0@lo:502: 00000100:00100000:2.0:1788744542.054551:0:7920:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744542.054595:0:7920:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220495300 going to sleep for 11 seconds 00000100:00100000:3.0:1788744542.054903:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475258240 00000100:00100000:3.0:1788744542.054914:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475258240 00000100:00100000:3.0:1788744542.054974:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788744542.054984:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+16:7920:x1875634475258240:12345-0@lo:502: 00000100:00100000:2.0:1788744542.055569:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+16:7920:x1875634475258240:12345-0@lo:502: Request processed in 584us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744542.055579:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788744542.055972:0:7920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:7920:1875634475258240:0@lo:502: 00000100:00100000:3.0:1788744542.056042:0:7920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:7920:1875634475258368:0@lo:502: 00000100:00100000:3.0:1788744542.056084:0:7920:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744542.056218:0:7920:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207fd6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744542.061002:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475258368 00000100:00100000:2.0:1788744542.061019:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475258368 00000100:00100000:2.0:1788744542.061146:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788744542.061159:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+16:7920:x1875634475258368:12345-0@lo:502: 00000100:00100000:2.0:1788744542.061495:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+16:7920:x1875634475258368:12345-0@lo:502: Request processed in 339us (5410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744542.061503:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788744542.061702:0:7920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:7920:1875634475258368:0@lo:502: 00000040:00080000:1.0:1788744542.061741:0:7920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788744542.063570:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788744542.063609:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788744542.063621:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a200031a00/0x4b162761eb391e91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e98 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.063634:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a200031a00/0x4b162761eb391e91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391e98 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744542.063664:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788744542.063667:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93a203f6f000 from 5 10000000:01000000:3.0:1788744542.063670:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788744542.063719:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.063728:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.063738:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744542.063761:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475258496:0@lo:101: 00000100:00100000:3.0:1788744542.063829:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744542.066048:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207fd6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744542.067107:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475258496 00000100:00100000:2.0:1788744542.067121:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475258496 00000100:00100000:2.0:1788744542.067207:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788744542.067216:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475258496:12345-0@lo:101: 00010000:00010000:2.0:1788744542.067236:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744542.067256:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a201472600/0x4b162761eb391ea6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391e9f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744542.067284:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a201472600/0x4b162761eb391ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391e9f expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744542.067294:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a201472600/0x4b162761eb391ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391e9f expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744542.067303:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a201472600, rc 0) 00000100:00100000:2.0:1788744542.067379:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475258496:12345-0@lo:101: Request processed in 164us (3550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744542.067386:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788744542.069072:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475258496:0@lo:101: 00010000:00010000:3.0:1788744542.069101:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391ea6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.069114:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391ea6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744542.069201:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475258624:0@lo:256: 00000100:00100000:3.0:1788744542.069264:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744542.069305:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207fd6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744542.069313:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475258624 00000100:00100000:2.0:1788744542.069320:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475258624 00000100:00100000:2.0:1788744542.069381:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788744542.069390:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475258624:12345-0@lo:256: 20000000:01000000:2.0:1788744542.069410:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788744542.069428:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788744542.069431:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788744542.069529:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475258624:12345-0@lo:256: Request processed in 140us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744542.069537:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788744542.069690:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475258624:0@lo:256: 10000000:01000000:0.0:1788744542.069736:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788744542.069743:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391ea6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744542.069753:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391ea6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744542.069761:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788744542.069764:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788744542.069767:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788744542.069793:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a200030400/0x4b162761eb391ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744542.069801:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a200030400/0x4b162761eb391ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744542.069809:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a200030400/0x4b162761eb391ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744542.069822:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475258752:0@lo:101: 00000100:00100000:0.0:1788744542.069870:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744542.069900:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744542.070005:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475258752 00000100:00100000:2.0:1788744542.070010:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475258752 00000100:00100000:2.0:1788744542.070044:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788744542.070051:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475258752:12345-0@lo:101: 00010000:00010000:2.0:1788744542.070060:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744542.070073:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a201472c00/0x4b162761eb391eb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391ead expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744542.070093:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a201472c00/0x4b162761eb391eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391ead expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744542.070103:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a201472c00/0x4b162761eb391eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391ead expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744542.070111:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a201472c00, rc 0) 00000100:00100000:2.0:1788744542.070176:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475258752:12345-0@lo:101: Request processed in 125us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744542.070182:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788744542.070322:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475258752:0@lo:101: 00010000:00010000:0.0:1788744542.070333:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a200030400/0x4b162761eb391ead lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391eb4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744542.070351:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a200030400/0x4b162761eb391ead lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391eb4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744542.070398:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475258880:0@lo:501: 00000100:00100000:0.0:1788744542.070423:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744542.070484:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578900 going to sleep for 11 seconds 00000100:00100000:3.0:1788744542.072964:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475258880 00000100:00100000:3.0:1788744542.072980:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475258880 00000100:00100000:2.0:1788744542.075064:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788744542.075078:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475258880:12345-0@lo:501: 00000100:00100000:2.0:1788744542.075438:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475258880:12345-0@lo:501: Request processed in 363us (5013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744542.075446:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788744542.075500:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475258880:0@lo:501: 00000100:00100000:2.0:1788744542.075551:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475259008:0@lo:503: 00000100:00100000:2.0:1788744542.075605:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744542.075635:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20d114900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744542.075659:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475259008 00000100:00100000:2.0:1788744542.075667:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475259008 00000100:00100000:2.0:1788744542.075687:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788744542.075694:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475259008:12345-0@lo:503: 00000100:00100000:2.0:1788744542.076271:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475259008:12345-0@lo:503: Request processed in 574us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744542.076279:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788744542.077118:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475259008:0@lo:503: 00000100:00100000:3.0:1788744542.077553:0:7921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d636680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:7921:1875634475259136:0@lo:502: 00000100:00100000:3.0:1788744542.077610:0:7921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744542.077642:0:7921:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207fd6540 going to sleep for 11 seconds 00000100:00100000:2.0:1788744542.077701:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475259136 00000100:00100000:2.0:1788744542.077708:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475259136 00000100:00100000:2.0:1788744542.077751:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788744542.077761:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+18:7921:x1875634475259136:12345-0@lo:502: 00000100:00100000:2.0:1788744542.078101:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+18:7921:x1875634475259136:12345-0@lo:502: Request processed in 340us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744542.078109:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788744542.078518:0:7921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d636680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:7921:1875634475259136:0@lo:502: 00000020:01000000:3.0:1788744542.078552:0:7921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788744542.078562:0:7921:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788744542.078569:0:7921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744542.078571:0:7921:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788744542.078576:0:7921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788744542.078579:0:7921:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:3.0:1788744542.078602:0:7921:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788744542.078604:0:7921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788744542.078631:0:7921:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93a1062599c0) 00000020:00000080:3.0:1788744542.078653:0:7921:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788744542.078659:0:7921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788744542.078731:0:7921:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788744542.078737:0:7921:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788744542.078745:0:7921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b162761eb391ec2 00010000:00080000:3.0:1788744542.078778:0:7921:0:(ldlm_lib.c:103:import_set_conn()) imp ffff93a23cd4c800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1788744542.079020:0:7921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1788744542.079721:0:7921:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788744542.079736:0:7921:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788744542.081238:0:7921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744542.083611:0:7921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744542.083683:0:7921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788744542.083751:0:7921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788744542.084877:0:7922:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744542.084883:0:7922:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788744542.085777:0:7921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788744542.085789:0:7921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788744542.085821:0:7921:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788744542.085843:0:7921:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b162761eb391ec9 00000100:00080000:2.0:1788744542.085852:0:7921:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788744542.085871:0:7921:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93a23cd4c800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1788744542.087003:0:7921:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a106fb6680 x1875634475259264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744542.087032:0:7921:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788744542.087209:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475259264:0@lo:8: 00000100:00100000:3.0:1788744542.087301:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744542.087601:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475259264 00000100:00100000:1.0:1788744542.087609:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475259264 00000100:00100000:1.0:1788744542.087638:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744542.087646:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3306:x1875634475259264:12345-0@lo:8: 00010000:00080000:1.0:1788744542.087685:0:6684:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:1.0:1788744542.087718:0:6684:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b162761eb391ed0 00002000:00100000:1.0:1788744542.087731:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93a23cd61800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788744542.087736:0:6684:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788744542.087739:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788744542.087864:0:6684:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788744542.088040:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788744542.088067:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93a23cd65800 : changing import state from RECOVER to FULL 00000020:01000000:2.0:1788744542.088069:0:7921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1788744542.088147:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875634475259264:12345-0@lo:8: Request processed in 483us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744542.088155:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744542.088183:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475259392:0@lo:400: 00000100:00100000:1.0:1788744542.088211:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744542.088233:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744542.088238:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475259520:0@lo:400: 00000100:00100000:1.0:1788744542.088257:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744542.088286:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475259648:0@lo:400: 00000100:00100000:1.0:1788744542.088308:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744542.088326:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744542.088331:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475259776:0@lo:400: 00000100:00100000:1.0:1788744542.088353:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744542.088380:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475259648 00000100:00100000:1.0:1788744542.088385:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475259648 00000020:00000080:2.0:1788744542.088401:0:7921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744542.088405:0:7921:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788744542.088410:0:7921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744542.088415:0:7921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744542.088417:0:7921:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788744542.088420:0:7921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000100:00100000:1.0:1788744542.088421:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000020:00000080:2.0:1788744542.088422:0:7921:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788744542.088428:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475259648:12345-0@lo:400: 00000100:00100000:2.0:1788744542.088449:0:7921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:7921:1875634475259904:0@lo:502: 00000100:00100000:1.0:1788744542.088463:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475259648:12345-0@lo:400: Request processed in 36us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744542.088474:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744542.088492:0:7921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744542.088493:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475259392 00000100:00100000:1.0:1788744542.088496:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475259392 00000100:00100000:1.0:1788744542.088513:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475259520 00000100:00100000:2.0:1788744542.088515:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475259904 00000100:00100000:1.0:1788744542.088516:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475259520 00000100:00100000:2.0:1788744542.088517:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475259904 00000100:00100000:1.0:1788744542.088526:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475259776 00000100:00100000:1.0:1788744542.088528:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475259776 00000100:00100000:1.0:1788744542.088541:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744542.088547:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475259392:12345-0@lo:400: 00000100:00100000:2.0:1788744542.088550:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788744542.088555:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:7921:x1875634475259904:12345-0@lo:502: 00000100:00100000:1.0:1788744542.088583:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475259392:12345-0@lo:400: Request processed in 37us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744542.088589:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744542.088600:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788744542.088606:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475259520:12345-0@lo:400: 00000100:00100000:1.0:1788744542.088631:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475259520:12345-0@lo:400: Request processed in 26us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744542.088636:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788744542.088646:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788744542.088651:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475259776:12345-0@lo:400: 00000100:00100000:1.0:1788744542.088673:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475259776:12345-0@lo:400: Request processed in 23us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744542.088678:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788744542.088705:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744542.088709:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788744542.088735:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a220a54e00 x1875634475259776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744542.088749:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475259776:0@lo:400: 00010000:00080000:1.0:1788744542.088766:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a220a54000 x1875634475259648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744542.088773:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475259648:0@lo:400: 00010000:00080000:1.0:1788744542.088799:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a220a54700 x1875634475259520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744542.088806:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475259520:0@lo:400: 00010000:00080000:1.0:1788744542.088814:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a220a55180 x1875634475259392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744542.088821:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475259392:0@lo:400: 00010000:00080000:1.0:1788744542.088853:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a106fb6680 x1875634475259264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788744552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744542.088860:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788744542.088866:0:3306:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788744542.088873:0:3306:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788744542.088878:0:3306:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788744542.088881:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a23cd4c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788744542.088903:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788744542.088909:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475259264:0@lo:8: 00000004:00080000:1.0:1788744542.088933:0:7922:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788744542.089052:0:7922:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 244787921745ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788744542.089635:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:7921:x1875634475259904:12345-0@lo:502: Request processed in 1077us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744542.089644:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788744542.090402:0:7921:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204971cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744542.090425:0:7921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:7921:1875634475259904:0@lo:502: 00000020:01000000:2.0:1788744542.090459:0:7921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744542.090467:0:7921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744542.090469:0:7921:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788744542.090474:0:7921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788744542.099598:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788744542.099635:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788744542.099648:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a200030400/0x4b162761eb391ead lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391eb4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.099661:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a200030400/0x4b162761eb391ead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391eb4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744542.099677:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788744542.099680:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93a207434d40 from 1 10000000:01000000:3.0:1788744542.099683:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788744542.099719:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.099727:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.099737:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744542.099759:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d636d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475260032:0@lo:101: 00000100:00100000:3.0:1788744542.099822:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744542.099874:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475260032 00000100:00100000:3.0:1788744542.099881:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475260032 00000100:00100000:3.0:1788744542.099939:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788744542.099948:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475260032:12345-0@lo:101: 00010000:00010000:3.0:1788744542.099961:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744542.099985:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e80800/0x4b162761eb391ede lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391ed7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.100007:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e80800/0x4b162761eb391ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391ed7 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.100017:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e80800/0x4b162761eb391ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391ed7 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.100026:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80800, rc 0) 00000100:00100000:3.0:1788744542.100063:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:5837:x1875634475260032:12345-0@lo:101: Request processed in 116us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744542.100069:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788744542.100113:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207fd6540 going to sleep for 11 seconds 00000100:00100000:3.0:1788744542.100163:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d636d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475260032:0@lo:101: 00010000:00010000:3.0:1788744542.100178:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391ed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391ede expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.100187:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391ed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391ede expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744542.100232:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d636d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475260160:0@lo:501: 00000100:00100000:3.0:1788744542.100253:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744542.100272:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475260160 00000100:00100000:3.0:1788744542.100275:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475260160 00000100:00100000:3.0:1788744542.100293:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788744542.100298:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:5837:x1875634475260160:12345-0@lo:501: 00000100:00100000:3.0:1788744542.100511:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:5837:x1875634475260160:12345-0@lo:501: Request processed in 212us (256us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744542.100518:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788744542.100540:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207fd6540 going to sleep for 11 seconds 00000100:00100000:3.0:1788744542.100550:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d636d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475260160:0@lo:501: 10000000:01000000:3.0:1788744542.100566:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788744542.100571:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391ed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391ede expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744542.100579:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391ede expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788744542.146436:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788744542.230494:0:7923:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788744542.230529:0:7923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d634e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7923:1875634475260416:0@lo:7: 00000100:00100000:3.0:1788744542.230595:0:7923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744542.230650:0:7923:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744542.230753:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475260288:0@lo:13: 00000100:00100000:1.0:1788744542.230783:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744542.230841:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475260416 00000100:00100000:1.0:1788744542.230860:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475260416 00000100:00100000:1.0:1788744542.230936:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744542.230945:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7923:x1875634475260416:12345-0@lo:7: 00000100:00080000:3.0:1788744542.231954:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788744542.232282:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475260288 00000100:00100000:3.0:1788744542.232292:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475260288 00000100:00100000:3.0:1788744542.232335:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744542.232343:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875634475260288:12345-0@lo:13: 00002000:00000024:3.0:1788744542.232371:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788744542.232447:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875634475260288:12345-0@lo:13: Request processed in 103us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744542.232453:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00002000:00080000:1.0:1788744542.237532:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788744542.237541:0:6685:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788744542.237623:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7923:x1875634475260416:12345-0@lo:7: Request processed in 6675us (7023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744542.237632:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788744542.237696:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23d636d80 x1875634475260288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744542.237719:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475260288:0@lo:13: 00010000:00080000:3.0:1788744542.239401:0:7923:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23d634e00 x1875634475260416/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788744558 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744542.239418:0:7923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d634e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7923:1875634475260416:0@lo:7: 00000004:00080000:3.0:1788744542.239431:0:7923:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788744542.239475:0:7923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d634e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7923:1875634475260544:0@lo:5: 00000100:00100000:3.0:1788744542.239528:0:7923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744542.239580:0:7923:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744542.239867:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475260544 00000100:00100000:1.0:1788744542.239875:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475260544 00000100:00100000:1.0:1788744542.239941:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744542.239952:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7923:x1875634475260544:12345-0@lo:5: 00002000:00080000:1.0:1788744542.239981:0:6684:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788744542.239986:0:6684:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788744542.240420:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7923:x1875634475260544:12345-0@lo:5: Request processed in 468us (890us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788744542.240429:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788744542.240470:0:7923:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23d634e00 x1875634475260544/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744558 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744542.240483:0:7923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d634e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7923:1875634475260544:0@lo:5: 00000004:00080000:1.0:1788744542.240492:0:7923:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788744542.240520:0:7923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a54700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7923:1875634475260672:0@lo:700: 00000100:00100000:1.0:1788744542.240549:0:7923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744542.240591:0:7923:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23f861d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744542.241271:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475260672 00000100:00100000:2.0:1788744542.241281:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475260672 00000100:00100000:2.0:1788744542.241344:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744542.241354:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7923:x1875634475260672:12345-0@lo:700: 00000100:00100000:2.0:1788744542.241398:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6691:1875634475260800:0@lo:700: 00000100:00100000:2.0:1788744542.241435:0:6691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744542.241467:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c785d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744542.241481:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475260800 00000100:00100000:2.0:1788744542.241485:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475260800 00000100:00100000:2.0:1788744542.241512:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744542.241519:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6691:x1875634475260800:12345-0@lo:700: 40000000:02000000:2.0:1788744542.311866:0:5847:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788744542.317383:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6691:x1875634475260800:12345-0@lo:700: Request processed in 75856us (75939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744542.317397:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788744542.317463:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a106fb6a00 x1875634475260800/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788744558 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744542.317478:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6691:1875634475260800:0@lo:700: 40000000:02000000:2.0:1788744542.317492:0:6691:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:0.0:1788744542.331795:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744542.454651:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7923:x1875634475260672:12345-0@lo:700: Request processed in 213290us (214091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744542.454671:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:0.0:1788744542.454718:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788744542.454729:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1788744542.454789:0:7923:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a220a54700 x1875634475260672/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788744558 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744542.454806:0:7923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a54700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7923:1875634475260672:0@lo:700: 00000004:02000040:2.0:1788744542.500880:0:7923:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788744542.512405:0:7923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7923:1875634475260928:0@lo:5: 00000100:00100000:2.0:1788744542.512492:0:7923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744542.512547:0:7923:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203fe3840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744542.515837:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475260928 00000100:00100000:1.0:1788744542.515851:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475260928 00000100:00100000:1.0:1788744542.515926:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744542.515937:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7923:x1875634475260928:12345-0@lo:5: 00002000:00080000:1.0:1788744542.532263:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788744542.532286:0:6685:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788744542.538105:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7923:x1875634475260928:12345-0@lo:5: Request processed in 22162us (25605us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788744542.538119:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788744542.542361:0:7923:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a106fb6a00 x1875634475260928/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744558 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744542.542397:0:7923:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788744542.542416:0:7923:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93a106fb6a00 x1875634475260928/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744558 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744542.542428:0:7923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7923:1875634475260928:0@lo:5: 00000004:00080000:3.0:1788744542.542444:0:7923:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1788744543.030831:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744543.030856:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475261056:0@lo:13: 00000100:00100000:2.0:1788744543.030940:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744543.031011:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475261056 00000100:00100000:2.0:1788744543.031020:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475261056 00000100:00100000:2.0:1788744543.031075:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744543.031083:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475261056:12345-0@lo:13: 00002000:00000024:2.0:1788744543.031118:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744543.031608:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475261056:12345-0@lo:13: Request processed in 524us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744543.031616:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788744543.031696:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a106fb7480 x1875634475261056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744543.031715:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475261056:0@lo:13: 00000001:02000400:0.0:1788744543.117608:0:7986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788744543.356334:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744544.373888:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744545.396759:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744546.422425:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744547.125951:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475261440:0@lo:400: 00000100:00100000:1.0:1788744547.126033:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744547.126095:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744547.126102:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475261568:0@lo:400: 00000100:00100000:1.0:1788744547.126151:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744547.126195:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475261440 00000100:00100000:1.0:1788744547.126203:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475261440 00000100:00100000:1.0:1788744547.126259:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788744547.126269:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475261440:12345-0@lo:400: 00000100:00100000:1.0:1788744547.126323:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475261440:12345-0@lo:400: Request processed in 56us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744547.126330:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788744547.126357:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475261568 00000100:00100000:1.0:1788744547.126361:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475261568 00000100:00100000:1.0:1788744547.126387:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744547.126394:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475261568:12345-0@lo:400: 00000100:00100000:1.0:1788744547.126423:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475261568:12345-0@lo:400: Request processed in 30us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744547.126446:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788744547.126465:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744547.126468:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788744547.126499:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a220a57480 x1875634475261568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744547.126513:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475261568:0@lo:400: 00010000:00080000:1.0:1788744547.126525:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a220a57b80 x1875634475261440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744547.126534:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475261440:0@lo:400: 00000100:00100000:0.0:1788744547.126612:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475261312:0@lo:400: 00000100:00100000:0.0:1788744547.126643:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744547.126680:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475261824:0@lo:400: 00000100:00100000:0.0:1788744547.126708:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744547.126731:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788744547.126737:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475261184:0@lo:400: 00000100:00100000:0.0:1788744547.126763:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744547.126780:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475261696:0@lo:400: 00000100:00100000:0.0:1788744547.126799:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744547.126836:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475261824 00000100:00100000:0.0:1788744547.126840:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475261824 00000100:00100000:0.0:1788744547.126873:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744547.126880:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875634475261824:12345-0@lo:400: 00000100:00100000:0.0:1788744547.126916:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875634475261824:12345-0@lo:400: Request processed in 37us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744547.126922:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788744547.126939:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744547.126947:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475261312 00000100:00100000:0.0:1788744547.126950:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475261312 00000100:00100000:0.0:1788744547.126966:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475261696 00000100:00100000:0.0:1788744547.126969:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475261696 00000100:00100000:0.0:1788744547.126986:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788744547.126992:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475261312:12345-0@lo:400: 00000100:00100000:0.0:1788744547.127020:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475261312:12345-0@lo:400: Request processed in 28us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744547.127025:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788744547.127037:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788744547.127043:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475261696:12345-0@lo:400: 00000100:00100000:0.0:1788744547.127068:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475261696:12345-0@lo:400: Request processed in 26us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744547.127081:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788744547.127095:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788744547.127112:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a220a54380 x1875634475261696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744547.127123:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475261696:0@lo:400: 00010000:00080000:0.0:1788744547.127163:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a220a57100 x1875634475261312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744547.127171:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475261312:0@lo:400: 00010000:00080000:0.0:1788744547.127179:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a220a56a00 x1875634475261824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744547.127186:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475261824:0@lo:400: 00000100:00100000:3.0:1788744547.127278:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475261184 00000100:00100000:3.0:1788744547.127283:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475261184 00000100:00100000:3.0:1788744547.127312:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788744547.127319:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475261184:12345-0@lo:400: 00000100:00100000:3.0:1788744547.127360:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475261184:12345-0@lo:400: Request processed in 42us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744547.127366:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788744547.127401:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475261184:0@lo:400: 00010000:00010000:0.0:1788744547.446508:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744547.644560:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475261952:0@lo:13: 00000100:00100000:1.0:1788744547.644635:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744547.645214:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475261952 00000100:00100000:2.0:1788744547.645223:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475261952 00000100:00100000:2.0:1788744547.645277:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744547.645287:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875634475261952:12345-0@lo:13: 00002000:00000024:2.0:1788744547.645323:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744547.645386:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875634475261952:12345-0@lo:13: Request processed in 101us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744547.645393:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788744547.646201:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23d634e00 x1875634475261952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744547.646225:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475261952:0@lo:13: 00000001:00080000:2.0:1788744547.735017:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1788744548.149232:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475262080:0@lo:13: 00000100:00100000:2.0:1788744548.149320:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744548.149396:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475262080 00000100:00100000:2.0:1788744548.149403:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475262080 00000100:00100000:2.0:1788744548.149452:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744548.149462:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475262080:12345-0@lo:13: 00002000:00000024:2.0:1788744548.149501:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744548.149545:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475262080:12345-0@lo:13: Request processed in 84us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744548.149552:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788744548.149596:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a106fb6300 x1875634475262080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744548.149628:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475262080:0@lo:13: 00010000:00010000:1.0:1788744548.470906:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744548.725087:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744548.725192:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451120256 00000100:00100000:0.0:1788744548.725202:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451120256 00000100:00100000:0.0:1788744548.725249:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 113 00000100:00100000:0.0:1788744548.725257:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2358:x1875634451120256:12345-192.168.201.6@tcp:250: 00010000:00080000:0.0:1788744548.725287:0:5834:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 24e1ca3b-eb53-4d85-8067-5e5e84d1d26d@192.168.201.6@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:0.0:1788744548.725316:0:5834:0:(genops.c:1384:class_connect()) connect: client 24e1ca3b-eb53-4d85-8067-5e5e84d1d26d, cookie 0x4b162761eb391ee5 00000100:00080000:1.0:1788744548.728331:0:5834:0:(import.c:65:import_set_state_nolock()) ffff93a23c099800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744548.728422:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+5:2358:x1875634451120256:12345-192.168.201.6@tcp:250: Request processed in 3159us (3341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744548.728433:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 113 00000100:00100000:1.0:1788744548.740824:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744548.740914:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451120384 00000100:00100000:0.0:1788744548.740925:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451120384 00000100:00100000:0.0:1788744548.740995:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 114 00000100:00100000:0.0:1788744548.741006:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+5:5588:x1875634451120384:12345-192.168.201.6@tcp:101: 00010000:00010000:0.0:1788744548.741026:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744548.741057:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a23d17fa00/0x4b162761eb391eec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d54d37 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744548.741111:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23d17fa00/0x4b162761eb391eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d37 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744548.741157:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a23d17fa00/0x4b162761eb391eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d37 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744548.741166:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17fa00, rc 0) 00000100:00100000:0.0:1788744548.741232:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+6:5588:x1875634451120384:12345-192.168.201.6@tcp:101: Request processed in 228us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744548.741239:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 114 00000100:00100000:2.0:1788744548.746750:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744548.747240:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451120512 00000100:00100000:1.0:1788744548.747251:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451120512 00000100:00100000:1.0:1788744548.747307:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:1.0:1788744548.747317:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+6:5588:x1875634451120512:12345-192.168.201.6@tcp:501: 00000100:00100000:1.0:1788744548.747596:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+6:5588:x1875634451120512:12345-192.168.201.6@tcp:501: Request processed in 280us (855us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788744548.747604:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:3.0:1788744548.759170:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744548.759250:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451120640 00000100:00100000:1.0:1788744548.759261:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451120640 00000100:00100000:1.0:1788744548.759319:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:1.0:1788744548.759331:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+6:5588:x1875634451120640:12345-192.168.201.6@tcp:101: 00010000:00010000:1.0:1788744548.759348:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744548.759366:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2027e6c00/0x4b162761eb391ef3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d54d3e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744548.759395:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2027e6c00/0x4b162761eb391ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d3e expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744548.759406:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2027e6c00/0x4b162761eb391ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d3e expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744548.759415:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2027e6c00, rc 0) 00000100:00100000:1.0:1788744548.759467:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+7:5588:x1875634451120640:12345-192.168.201.6@tcp:101: Request processed in 139us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744548.759474:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:3.0:1788744548.761589:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744548.761667:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451120768 00000100:00100000:1.0:1788744548.761679:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451120768 00000100:00100000:1.0:1788744548.761734:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:1.0:1788744548.761743:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+7:5588:x1875634451120768:12345-192.168.201.6@tcp:501: 00000100:00100000:1.0:1788744548.762070:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+8:5588:x1875634451120768:12345-192.168.201.6@tcp:501: Request processed in 327us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744548.762089:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:3.0:1788744548.764044:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744548.764151:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451120896 00000100:00100000:1.0:1788744548.764161:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451120896 00000100:00100000:1.0:1788744548.764204:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00100000:1.0:1788744548.764213:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+8:5588:x1875634451120896:12345-192.168.201.6@tcp:503: 00000100:00100000:1.0:1788744548.764561:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+8:5588:x1875634451120896:12345-192.168.201.6@tcp:503: Request processed in 348us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744548.764570:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00100000:3.0:1788744548.773088:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744548.773257:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451121024 00000100:00100000:0.0:1788744548.773268:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451121024 00000100:00100000:0.0:1788744548.773324:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 119 00000100:00100000:0.0:1788744548.773334:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+8:5606:x1875634451121024:12345-192.168.201.6@tcp:502: 00000100:00100000:0.0:1788744548.773712:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+8:5606:x1875634451121024:12345-192.168.201.6@tcp:502: Request processed in 378us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744548.773722:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 119 00000100:00100000:2.0:1788744548.795418:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744548.795448:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451121152 00000100:00100000:1.0:1788744548.795458:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451121152 00000100:00100000:1.0:1788744548.795519:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:1.0:1788744548.795557:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+8:5606:x1875634451121152:12345-192.168.201.6@tcp:502: 00000100:00100000:1.0:1788744548.795834:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+8:5606:x1875634451121152:12345-192.168.201.6@tcp:502: Request processed in 279us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744548.795851:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:2.0:1788744548.809551:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744548.809975:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451121280 00000100:00100000:3.0:1788744548.809986:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451121280 00000100:00100000:3.0:1788744548.810683:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:3.0:1788744548.810706:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+8:5588:x1875634451121280:12345-192.168.201.6@tcp:101: 00010000:00010000:3.0:1788744548.810729:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744548.810789:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e81a00/0x4b162761eb391efa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d54d68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744548.810837:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e81a00/0x4b162761eb391efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d68 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744548.810850:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e81a00/0x4b162761eb391efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d68 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744548.810859:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81a00, rc 0) 00000100:00100000:3.0:1788744548.810933:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:5588:x1875634451121280:12345-192.168.201.6@tcp:101: Request processed in 240us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744548.810940:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:3.0:1788744548.814441:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744548.814539:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451121408 00000100:00100000:2.0:1788744548.814549:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451121408 00000100:00100000:2.0:1788744548.814607:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:2.0:1788744548.814617:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a203d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:5588:x1875634451121408:12345-192.168.201.6@tcp:256: 20000000:01000000:2.0:1788744548.814641:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788744548.814664:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788744548.814668:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788744548.814671:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788744548.814674:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788744548.816501:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a203d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:5588:x1875634451121408:12345-192.168.201.6@tcp:256: Request processed in 1875us (2060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744548.816514:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:2.0:1788744548.824010:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744548.824112:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451121536 00000100:00100000:3.0:1788744548.824124:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451121536 00000100:00100000:3.0:1788744548.824206:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:3.0:1788744548.824216:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a203d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:5588:x1875634451121536:12345-192.168.201.6@tcp:101: 00010000:00010000:3.0:1788744548.824236:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744548.824256:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e81e00/0x4b162761eb391f01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d54d6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744548.824286:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e81e00/0x4b162761eb391f01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d6f expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744548.824298:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e81e00/0x4b162761eb391f01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d6f expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744548.824308:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81e00, rc 0) 00000100:00100000:3.0:1788744548.826177:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a203d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5588:x1875634451121536:12345-192.168.201.6@tcp:101: Request processed in 1953us (2169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744548.826200:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:3.0:1788744548.829627:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744548.830172:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451121664 00000100:00100000:0.0:1788744548.830183:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451121664 00000100:00100000:0.0:1788744548.830232:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 124 00000100:00100000:0.0:1788744548.830242:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5588:x1875634451121664:12345-192.168.201.6@tcp:501: 00000100:00100000:0.0:1788744548.830536:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5588:x1875634451121664:12345-192.168.201.6@tcp:501: Request processed in 295us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744548.830544:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 124 00000100:00100000:3.0:1788744548.833491:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744548.833571:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451121792 00000100:00100000:2.0:1788744548.833581:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451121792 00000100:00100000:2.0:1788744548.833625:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 125 00000100:00100000:2.0:1788744548.833632:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5588:x1875634451121792:12345-192.168.201.6@tcp:503: 00000100:00100000:2.0:1788744548.833973:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5588:x1875634451121792:12345-192.168.201.6@tcp:503: Request processed in 339us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744548.833981:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 125 00000100:00100000:3.0:1788744548.844720:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744548.844815:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451121920 00000100:00100000:0.0:1788744548.844842:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451121920 00000100:00100000:0.0:1788744548.844907:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:0.0:1788744548.844917:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5609:x1875634451121920:12345-192.168.201.6@tcp:502: 00000100:00100000:0.0:1788744548.845858:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5609:x1875634451121920:12345-192.168.201.6@tcp:502: Request processed in 938us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744548.845867:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:3.0:1788744548.851123:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744548.851189:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451122048 00000100:00100000:3.0:1788744548.851201:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451122048 00000100:00100000:3.0:1788744548.851249:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 127 00000100:00100000:3.0:1788744548.851260:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5609:x1875634451122048:12345-192.168.201.6@tcp:502: 00000100:00100000:3.0:1788744548.851471:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5609:x1875634451122048:12345-192.168.201.6@tcp:502: Request processed in 212us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744548.851479:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 127 00000100:00100000:0.0:1788744548.869043:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744548.869458:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451122176 00000100:00100000:3.0:1788744548.869469:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451122176 00000100:00100000:3.0:1788744548.869529:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:3.0:1788744548.869537:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2358:x1875634451122176:12345-192.168.201.6@tcp:38: 00010000:00080000:3.0:1788744548.869567:0:5840:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:3.0:1788744548.869616:0:5840:0:(genops.c:1384:class_connect()) connect: client 390441fa-c0e0-4bda-b106-b1a75da212d8, cookie 0x4b162761eb391f08 00000004:00100000:3.0:1788744548.869648:0:5840:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:3.0:1788744548.869653:0:5840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788744548.934970:0:5840:0:(import.c:65:import_set_state_nolock()) ffff93a23c7b9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744548.935243:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2358:x1875634451122176:12345-192.168.201.6@tcp:38: Request processed in 65703us (66218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744548.935254:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00010000:00010000:0.0:1788744549.496099:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744549.687606:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744549.687680:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744549.687810:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451122304 00000100:00100000:1.0:1788744549.687821:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451122304 00000100:00100000:1.0:1788744549.687882:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451122432 00000100:00100000:1.0:1788744549.687884:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451122432 00000100:00100000:1.0:1788744549.687897:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:1.0:1788744549.687903:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+7:0:x1875634451122304:12345-192.168.201.6@tcp:41: 00000004:00000024:1.0:1788744549.687946:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788744549.688004:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+7:0:x1875634451122304:12345-192.168.201.6@tcp:41: Request processed in 101us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744549.688021:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:1.0:1788744549.688036:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1788744549.688040:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:5588:x1875634451122432:12345-192.168.201.6@tcp:41: 00000004:00000024:1.0:1788744549.688048:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788744549.688062:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:5588:x1875634451122432:12345-192.168.201.6@tcp:41: Request processed in 22us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744549.688066:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00080000:2.0:1788744549.688331:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744549.689724:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744549.689861:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451122560 00000100:00100000:2.0:1788744549.689869:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451122560 00000100:00100000:2.0:1788744549.689917:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:2.0:1788744549.689925:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:5588:x1875634451122560:12345-192.168.201.6@tcp:40: 00000100:00100000:2.0:1788744549.690061:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:5588:x1875634451122560:12345-192.168.201.6@tcp:40: Request processed in 137us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744549.690066:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1788744549.695089:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744549.695229:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451122688 00000100:00100000:0.0:1788744549.695240:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451122688 00000100:00100000:0.0:1788744549.695301:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:0.0:1788744549.695311:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875634451122688:12345-192.168.201.6@tcp:8: 00010000:00080000:0.0:1788744549.695343:0:6684:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:0.0:1788744549.695378:0:6684:0:(genops.c:1384:class_connect()) connect: client 390441fa-c0e0-4bda-b106-b1a75da212d8, cookie 0x4b162761eb391f0f 00002000:00100000:0.0:1788744549.695391:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 390441fa-c0e0-4bda-b106-b1a75da212d8/ffff93a23c09f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788744549.695420:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788744549.695754:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788744549.695800:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93a23c09e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744549.695878:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2358:x1875634451122688:12345-192.168.201.6@tcp:8: Request processed in 566us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744549.695886:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1788744549.695997:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744549.696201:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451122816 00000100:00100000:2.0:1788744549.696208:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451122816 00000100:00100000:2.0:1788744549.696242:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1788744549.696248:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1875634451122816:12345-192.168.201.6@tcp:8: 00010000:00080000:2.0:1788744549.696265:0:6682:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:2.0:1788744549.696288:0:6682:0:(genops.c:1384:class_connect()) connect: client 390441fa-c0e0-4bda-b106-b1a75da212d8, cookie 0x4b162761eb391f16 00002000:00100000:2.0:1788744549.696295:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 390441fa-c0e0-4bda-b106-b1a75da212d8/ffff93a23c7be000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788744549.696314:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788744549.696564:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788744549.696583:0:6682:0:(import.c:65:import_set_state_nolock()) ffff93a23c7bb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744549.696619:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2358:x1875634451122816:12345-192.168.201.6@tcp:8: Request processed in 370us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744549.696625:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:3.0:1788744549.696942:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744549.697271:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451122944 00000100:00100000:1.0:1788744549.697277:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451122944 00000100:00100000:3.0:1788744549.697298:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744549.697320:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1788744549.697329:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:5588:x1875634451122944:12345-192.168.201.6@tcp:33: 00000100:00100000:0.0:1788744549.697487:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451123072 00000100:00100000:0.0:1788744549.697492:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451123072 00000100:00100000:0.0:1788744549.697561:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 128 00000100:00100000:0.0:1788744549.697570:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2360:x1875634451123072:12345-192.168.201.6@tcp:400: 00000100:00100000:0.0:1788744549.697617:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2360:x1875634451123072:12345-192.168.201.6@tcp:400: Request processed in 48us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744549.697638:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 128 00000004:00080000:2.0:1788744549.712825:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 15435us 00000004:00200000:3.0:1788744549.719739:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788744549.719909:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:5588:x1875634451122944:12345-192.168.201.6@tcp:33: Request processed in 22574us (22960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744549.719932:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1788744549.866465:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744549.866640:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451123200 00000100:00100000:0.0:1788744549.866650:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451123200 00000100:00100000:0.0:1788744549.866720:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:0.0:1788744549.866731:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:5626:x1875634451123200:12345-192.168.201.6@tcp:101: 00010000:00010000:0.0:1788744549.866751:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744549.866829:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb391f1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54d99 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744549.866900:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb391f24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744549.866915:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb391f24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744549.866931:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb391f24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744549.866966:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788744549.866969:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744549.866983:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb391f24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744549.867002:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb391f1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d99 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744549.867025:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb391f24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d99 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744549.867046:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a203c30300) 00010000:00010000:0.0:1788744549.867048:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744549.867052:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17ea00, rc 0) 00000100:00100000:0.0:1788744549.867102:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+7:5626:x1875634451123200:12345-192.168.201.6@tcp:101: Request processed in 374us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744549.867107:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00010000:00010000:1.0:1788744550.516280:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744551.543157:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744551.913841:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744551.914105:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451123328 00000100:00100000:2.0:1788744551.914115:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451123328 00000100:00100000:2.0:1788744551.914221:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1788744551.914231:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+7:5678:x1875634451123328:12345-192.168.201.6@tcp:41: 00000004:00000024:2.0:1788744551.914291:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:0.0:1788744551.914368:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744551.914381:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+7:5678:x1875634451123328:12345-192.168.201.6@tcp:41: Request processed in 150us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744551.914389:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:1.0:1788744551.918406:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744551.918564:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451123456 00000100:00100000:2.0:1788744551.918586:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451123456 00000100:00100000:2.0:1788744551.918663:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1788744551.918674:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:390441fa-c0e0-4bda-b106-b1a75da212d8+6:5678:x1875634451123456:12345-192.168.201.6@tcp:13: 00002000:00000024:2.0:1788744551.918711:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744551.918828:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:390441fa-c0e0-4bda-b106-b1a75da212d8+6:5678:x1875634451123456:12345-192.168.201.6@tcp:13: Request processed in 156us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744551.918835:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00080000:0.0:1788744551.919171:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744551.928854:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744551.934580:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451123584 00000100:00100000:2.0:1788744551.934595:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451123584 00000100:00100000:2.0:1788744551.934755:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:2.0:1788744551.934765:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:390441fa-c0e0-4bda-b106-b1a75da212d8+6:5678:x1875634451123584:12345-192.168.201.6@tcp:13: 00002000:00000024:2.0:1788744551.934803:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744551.934875:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:390441fa-c0e0-4bda-b106-b1a75da212d8+6:5678:x1875634451123584:12345-192.168.201.6@tcp:13: Request processed in 110us (6032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744551.934882:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00080000:0.0:1788744551.940237:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744552.249206:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475262464:0@lo:400: 00000100:00100000:2.0:1788744552.249290:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744552.249386:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744552.249393:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475262592:0@lo:400: 00000100:00100000:2.0:1788744552.249421:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744552.249463:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475262592 00000100:00100000:2.0:1788744552.249471:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475262592 00000100:00100000:2.0:1788744552.249531:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744552.249539:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475262592:12345-0@lo:400: 00000100:00100000:2.0:1788744552.249587:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475262592:12345-0@lo:400: Request processed in 49us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744552.249593:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788744552.249629:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a241d74380 x1875634475262592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744552.249642:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475262592:0@lo:400: 00000100:00100000:1.0:1788744552.249838:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475262208:0@lo:400: 00000100:00100000:1.0:1788744552.249880:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744552.249911:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475262720:0@lo:400: 00000100:00100000:1.0:1788744552.249934:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744552.249955:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788744552.249961:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475262336:0@lo:400: 00000100:00100000:1.0:1788744552.249995:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744552.250019:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475262848:0@lo:400: 00000100:00100000:1.0:1788744552.250041:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744552.250070:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475262848 00000100:00100000:1.0:1788744552.250075:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475262848 00000100:00100000:1.0:1788744552.250105:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744552.250112:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475262848:12345-0@lo:400: 00000100:00100000:1.0:1788744552.250175:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475262848:12345-0@lo:400: Request processed in 64us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744552.250182:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744552.250200:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475262464 00000100:00100000:1.0:1788744552.250204:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475262464 00000100:00100000:1.0:1788744552.250224:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475262720 00000100:00100000:1.0:1788744552.250227:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475262720 00000100:00100000:1.0:1788744552.250239:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475262336 00000100:00100000:1.0:1788744552.250241:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475262336 00000100:00100000:1.0:1788744552.250256:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744552.250262:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475262464:12345-0@lo:400: 00000100:00100000:1.0:1788744552.250297:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475262464:12345-0@lo:400: Request processed in 35us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744552.250304:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744552.250316:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788744552.250321:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475262720:12345-0@lo:400: 00000100:00100000:1.0:1788744552.250362:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475262720:12345-0@lo:400: Request processed in 40us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744552.250367:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788744552.250379:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744552.250385:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c079880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475262336:12345-0@lo:400: 00000100:00100000:1.0:1788744552.250411:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c079880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475262336:12345-0@lo:400: Request processed in 26us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744552.250424:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744552.250456:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475262336:0@lo:400: 00010000:00080000:1.0:1788744552.250467:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a241d77b80 x1875634475262848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744552.250475:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788744552.250486:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475262848:0@lo:400: 00000100:00100000:1.0:1788744552.250496:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475262720:0@lo:400: 00000100:00100000:2.0:1788744552.250638:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475262208 00000100:00100000:2.0:1788744552.250643:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475262208 00000100:00100000:2.0:1788744552.250669:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788744552.250676:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475262208:12345-0@lo:400: 00000100:00100000:2.0:1788744552.250710:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475262208:12345-0@lo:400: Request processed in 34us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744552.250728:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788744552.250769:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475262464:0@lo:400: 00000100:00100000:1.0:1788744552.251506:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475262208:0@lo:400: 00000100:00080000:0.0:1788744552.252196:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744552.252203:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744552.252206:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788744552.564354:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744552.763407:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475262976:0@lo:13: 00000100:00100000:2.0:1788744552.763477:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744552.763817:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475262976 00000100:00100000:3.0:1788744552.763826:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475262976 00000100:00100000:3.0:1788744552.763913:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788744552.763924:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475262976:12345-0@lo:13: 00002000:00000024:3.0:1788744552.763952:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744552.764075:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475262976:12345-0@lo:13: Request processed in 153us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744552.764082:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788744552.765653:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a241d76300 x1875634475262976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744552.765678:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475262976:0@lo:13: 00000100:00100000:0.0:1788744553.279353:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744553.279380:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475263104:0@lo:13: 00000100:00100000:0.0:1788744553.279456:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744553.279578:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475263104 00000100:00100000:1.0:1788744553.279586:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475263104 00000100:00100000:1.0:1788744553.279639:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744553.279649:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475263104:12345-0@lo:13: 00002000:00000024:1.0:1788744553.279673:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744553.279735:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475263104:12345-0@lo:13: Request processed in 87us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744553.279741:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788744553.279779:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c07b800 x1875634475263104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744553.279796:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475263104:0@lo:13: 00010000:00010000:0.0:1788744553.589828:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788744554.354721:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 390441fa-c0e0-4bda-b106-b1a75da212d8 00000001:00100000:2.0:1788744554.363975:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 390441fa-c0e0-4bda-b106-b1a75da212d8 00000001:02000400:0.0:1788744554.473968:0:8290:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788744554.614370:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788744554.853429:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 390441fa-c0e0-4bda-b106-b1a75da212d8 00000100:00100000:1.0:1788744554.924047:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744554.924095:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744554.924176:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744554.924209:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744554.924246:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451123968 00000100:00100000:1.0:1788744554.924256:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451123968 00000100:00100000:1.0:1788744554.924318:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451124096 00000100:00100000:1.0:1788744554.924322:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451124096 00000100:00100000:1.0:1788744554.924340:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1788744554.924350:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2362:x1875634451123968:12345-192.168.201.6@tcp:400: 00000100:00100000:1.0:1788744554.924422:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2362:x1875634451123968:12345-192.168.201.6@tcp:400: Request processed in 73us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744554.924429:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1788744554.924448:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:1.0:1788744554.924455:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2362:x1875634451124096:12345-192.168.201.6@tcp:400: 00000100:00100000:1.0:1788744554.924495:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2362:x1875634451124096:12345-192.168.201.6@tcp:400: Request processed in 41us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744554.924502:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00080000:1.0:1788744554.924518:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744554.924522:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744554.924696:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451123840 00000100:00100000:3.0:1788744554.924702:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451123840 00000100:00100000:3.0:1788744554.924748:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:3.0:1788744554.924757:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451123840:12345-192.168.201.6@tcp:400: 00000100:00100000:3.0:1788744554.924794:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451123840:12345-192.168.201.6@tcp:400: Request processed in 39us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744554.924799:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00080000:1.0:1788744554.925453:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744554.926870:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451123712 00000100:00100000:0.0:1788744554.926881:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451123712 00000100:00100000:0.0:1788744554.926941:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 130 00000100:00100000:0.0:1788744554.926951:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2362:x1875634451123712:12345-192.168.201.6@tcp:400: 00000100:00100000:0.0:1788744554.927019:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2362:x1875634451123712:12345-192.168.201.6@tcp:400: Request processed in 69us (2982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744554.927025:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 130 00010000:00010000:0.0:1788744555.641883:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744556.666441:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788744557.352156:0:8440:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff53381d20 20000000:00000080:1.0:1788744557.352175:0:8440:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93a20488a800 uarg=0000000000000000 20000000:01000000:1.0:1788744557.352209:0:8440:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788744557.352212:0:8440:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788744557.352215:0:8440:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788744557.352219:0:8440:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788744557.352224:0:8440:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788744557.352246:0:8440:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788744557.352249:0:8440:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788744557.352437:0:8440:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788744557.352440:0:8440:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788744557.354992:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788744557.355765:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788744557.355833:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788744557.355867:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1788744557.356090:0:8440:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788744557.356094:0:8440:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788744557.357709:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788744557.358476:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788744557.358525:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788744557.358558:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1788744557.358571:0:8440:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788744557.358574:0:8440:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788744557.359477:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788744557.359829:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788744557.359970:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788744557.360013:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1788744557.360026:0:8440:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788744557.360029:0:8440:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788744557.361011:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788744557.361572:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788744557.361618:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788744557.361685:0:8440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:1.0:1788744557.361700:0:8440:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788744557.361719:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.361737:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a238530400/0x4b162761eb391e28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391e21 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.361745:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a200031e00/0x4b162761eb391e52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391e4b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.361751:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a201473000/0x4b162761eb391e7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391e75 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.361763:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a238531400/0x4b162761eb391e8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391e83 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.361769:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a238531800/0x4b162761eb391e98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391e91 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.361776:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a201472c00/0x4b162761eb391eb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391ead expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.361783:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a107e80800/0x4b162761eb391ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391ed7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.361792:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a23d17fa00/0x4b162761eb391eec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d37 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.361800:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a2027e6c00/0x4b162761eb391ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d3e expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.361807:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.361847:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a2027e6c00/0x4b162761eb391ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d3e expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.361865:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93a2027e6c00/0x4b162761eb391ef3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d3e expref: 9 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744557.362019:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c078700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475263232:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744557.362266:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a23d17fa00/0x4b162761eb391eec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d37 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.362282:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93a23d17fa00/0x4b162761eb391eec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d37 expref: 9 pid: 5833 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744557.362291:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c078000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475263360:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744557.362328:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a107e80800/0x4b162761eb391ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391ed7 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.362337:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a107e80800/0x4b162761eb391ede lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391ed7 expref: 18 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744557.362346:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c078e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475263488:0@lo:104: 00000100:00100000:1.0:1788744557.362387:0:8440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744557.362436:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a201472c00/0x4b162761eb391eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391ead expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.362444:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a201472c00/0x4b162761eb391eb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391ead expref: 18 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744557.362452:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475263616:0@lo:104: 00000100:00100000:1.0:1788744557.362471:0:8440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744557.362493:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a238531800/0x4b162761eb391e98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391e91 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.362501:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a238531800/0x4b162761eb391e98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391e91 expref: 18 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744557.362508:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475263744:0@lo:104: 00010000:00010000:1.0:1788744557.362525:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a238531400/0x4b162761eb391e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391e83 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.362538:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a238531400/0x4b162761eb391e8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391e83 expref: 18 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744557.362546:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475263872:0@lo:104: 00010000:00010000:1.0:1788744557.362564:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a201473000/0x4b162761eb391e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391e75 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.362572:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a201473000/0x4b162761eb391e7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391e75 expref: 18 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744557.362579:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475264000:0@lo:104: 00010000:00010000:1.0:1788744557.362593:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a200031e00/0x4b162761eb391e52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391e4b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.362601:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a200031e00/0x4b162761eb391e52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391e4b expref: 18 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744557.362608:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c079500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475264128:0@lo:104: 00010000:00010000:1.0:1788744557.362638:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a238530400/0x4b162761eb391e28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391e21 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.362646:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a238530400/0x4b162761eb391e28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391e21 expref: 18 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744557.362653:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c078380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475264256:0@lo:104: 00000100:00100000:1.0:1788744557.362690:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20489e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744557.362921:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788744557.362940:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744557.362953:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744557.362962:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744557.362969:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744557.362975:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744557.362982:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475263488 00000100:00100000:3.0:1788744557.362988:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475263488 00000100:00100000:3.0:1788744557.363021:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475263616 00000100:00100000:3.0:1788744557.363023:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475263616 00000100:00100000:3.0:1788744557.363041:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475263744 00000100:00100000:3.0:1788744557.363044:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475263744 00000100:00100000:3.0:1788744557.363051:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475263872 00000100:00100000:3.0:1788744557.363054:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475263872 00000100:00100000:3.0:1788744557.363062:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475264000 00000100:00100000:3.0:1788744557.363064:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475264000 00000100:00100000:3.0:1788744557.363071:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475264128 00000100:00100000:3.0:1788744557.363072:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475264128 00000100:00100000:3.0:1788744557.363078:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475264256 00000100:00100000:3.0:1788744557.363080:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475264256 00000100:00100000:3.0:1788744557.363090:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788744557.363098:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+9:8440:x1875634475263488:12345-0@lo:104: 00010000:00010000:3.0:1788744557.363110:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391ede expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.363219:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788744557.363225:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c079f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+9:8440:x1875634475263488:12345-0@lo:104: Request processed in 128us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744557.363232:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788744557.363250:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744557.363256:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c083c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+8:8440:x1875634475263616:12345-0@lo:104: 00010000:00010000:3.0:1788744557.363264:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a200030400/0x4b162761eb391ead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391eb4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.363298:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788744557.363303:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c083c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+8:8440:x1875634475263616:12345-0@lo:104: Request processed in 48us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744557.363309:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744557.363344:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744557.363350:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+7:8440:x1875634475263744:12345-0@lo:104: 00010000:00010000:3.0:1788744557.363363:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a200031a00/0x4b162761eb391e91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391e98 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744557.363611:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c078e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475263488:0@lo:104: 00000100:00100000:1.0:1788744557.363619:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475263616:0@lo:104: 00000100:00100000:1.0:1788744557.363649:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475263744:0@lo:104: 00010000:00010000:3.0:1788744557.363680:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788744557.363687:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+7:8440:x1875634475263744:12345-0@lo:104: Request processed in 338us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744557.363692:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744557.363705:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744557.363712:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+6:8440:x1875634475263872:12345-0@lo:104: 00010000:00010000:3.0:1788744557.363719:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a238531600/0x4b162761eb391e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391e8a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.363759:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788744557.363764:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+6:8440:x1875634475263872:12345-0@lo:104: Request processed in 53us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744557.363769:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744557.363781:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744557.363787:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+5:8440:x1875634475264000:12345-0@lo:104: 00010000:00010000:3.0:1788744557.363793:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391e7c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.363816:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788744557.363820:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+5:8440:x1875634475264000:12345-0@lo:104: Request processed in 35us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744557.363825:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744557.363835:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788744557.363840:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+4:8440:x1875634475264128:12345-0@lo:104: 00010000:00010000:3.0:1788744557.363853:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a238530c00/0x4b162761eb391e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391e52 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.363943:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788744557.363949:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+4:8440:x1875634475264128:12345-0@lo:104: Request processed in 109us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744557.363955:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788744557.363968:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788744557.363974:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+3:8440:x1875634475264256:12345-0@lo:104: 00010000:00010000:3.0:1788744557.363981:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a201473c00/0x4b162761eb391e21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391e28 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.364008:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788744557.364013:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+3:8440:x1875634475264256:12345-0@lo:104: Request processed in 40us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744557.364018:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788744557.364036:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788744557.364043:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391ede expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.364050:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238530000 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744557.364054:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391ede expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.364062:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391ede expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744557.364069:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391ede expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744557.364081:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744557.364112:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391ed7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391ede expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744557.364218:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475263872:0@lo:104: 00000100:00100000:1.0:1788744557.364227:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475264000:0@lo:104: 00000100:00100000:1.0:1788744557.364232:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c079500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475264128:0@lo:104: 00000100:00100000:1.0:1788744557.364239:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c078380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475264256:0@lo:104: 00010000:00010000:3.0:1788744557.364291:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744557.364315:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391ed7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391ede expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.364321:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a238530000/0x4b162761eb391ed7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391ede expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.364333:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788744557.364336:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a200030400/0x4b162761eb391ead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391eb4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.364342:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200030400 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744557.364345:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a200030400/0x4b162761eb391ead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391eb4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.364351:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a200030400/0x4b162761eb391ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391eb4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744557.364357:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a200030400/0x4b162761eb391ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391eb4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744557.364361:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744557.364375:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a200030400/0x4b162761eb391ead lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391eb4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.364381:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744557.364392:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a200030400/0x4b162761eb391ead lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391eb4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.364520:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000100:00100000:0.0:1788744557.364544:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475264512:0@lo:103: 00000100:00100000:0.0:1788744557.364581:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744557.364622:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744557.364640:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475264384:0@lo:103: 00000100:00100000:0.0:1788744557.364662:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744557.364688:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475264512 00000100:00100000:0.0:1788744557.364693:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475264512 00010000:00010000:0.0:1788744557.364713:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a201472c00/0x4b162761eb391eb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391ead expref: 19 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744557.364736:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475264384 00000100:00100000:0.0:1788744557.364738:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475264384 00010000:00010000:0.0:1788744557.364747:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a107e80800/0x4b162761eb391ede lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391ed7 expref: 20 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744557.364761:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788744557.364767:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+20:3308:x1875634475264512:12345-0@lo:103: 00010000:00010000:0.0:1788744557.364777:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744557.364782:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a201472c00/0x4b162761eb391eb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391ead expref: 20 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.364790:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a201472c00/0x4b162761eb391eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391ead expref: 20 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.364804:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a201472c00/0x4b162761eb391eb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391ead expref: 20 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.364820:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744557.364845:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475264512:12345-0@lo:103: Request processed in 78us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744557.364857:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788744557.364870:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788744557.364887:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+18:3308:x1875634475264384:12345-0@lo:103: 00010000:00010000:0.0:1788744557.364896:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744557.364900:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a107e80800/0x4b162761eb391ede lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391ed7 expref: 18 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.364909:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a107e80800/0x4b162761eb391ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391ed7 expref: 18 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.364918:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a107e80800/0x4b162761eb391ede lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391ed7 expref: 18 pid: 5834 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.364927:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744557.364949:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+17:3308:x1875634475264384:12345-0@lo:103: Request processed in 74us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744557.364954:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788744557.364981:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475264384:0@lo:103: 00000100:00100000:0.0:1788744557.364988:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475264512:0@lo:103: 00010000:00010000:0.0:1788744557.365265:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788744557.365273:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a200031a00/0x4b162761eb391e91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391e98 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.365281:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200031a00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1788744557.365284:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a200031a00/0x4b162761eb391e91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391e98 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.365303:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a200031a00/0x4b162761eb391e91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391e98 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744557.365310:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a200031a00/0x4b162761eb391e91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391e98 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744557.365315:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744557.365332:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a200031a00/0x4b162761eb391e91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e98 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.365337:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744557.365359:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a200031a00/0x4b162761eb391e91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e98 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.365366:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a200031a00/0x4b162761eb391e91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e98 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.365377:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788744557.365381:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391e7c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.365386:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200030000 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1788744557.365388:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391e75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391e7c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.365507:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a200030400/0x4b162761eb391ead lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391eb4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.365518:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788744557.365521:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a238530c00/0x4b162761eb391e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391e52 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.365527:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238530c00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744557.365529:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a238530c00/0x4b162761eb391e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391e52 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.365536:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a238530c00/0x4b162761eb391e4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391e52 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744557.365541:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a238530c00/0x4b162761eb391e4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391e52 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744557.365546:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744557.365560:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a238530c00/0x4b162761eb391e4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e52 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.365566:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744557.365572:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a238530c00/0x4b162761eb391e4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e52 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.365578:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a238530c00/0x4b162761eb391e4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e52 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.365587:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744557.365597:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a201473c00/0x4b162761eb391e21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391e28 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.365603:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201473c00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744557.365605:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a201473c00/0x4b162761eb391e21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391e28 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.365613:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a201473c00/0x4b162761eb391e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391e28 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744557.365619:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a201473c00/0x4b162761eb391e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391e28 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744557.365624:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744557.365650:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a201473c00/0x4b162761eb391e21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e28 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.365656:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744557.365668:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a201473c00/0x4b162761eb391e21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e28 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.365674:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a201473c00/0x4b162761eb391e21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e28 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.365684:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744557.365685:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744557.365687:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744557.365781:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391e7c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744557.365789:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391e7c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744557.365800:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744557.365824:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391e75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e7c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.365830:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744557.365836:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391e75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e7c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.365842:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a200030000/0x4b162761eb391e75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e7c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.365851:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744557.365853:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744557.365854:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744557.365943:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475264640:0@lo:103: 00000100:00100000:0.0:1788744557.365980:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744557.366013:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744557.366019:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475264768:0@lo:103: 00000100:00100000:0.0:1788744557.366041:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744557.366106:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475265024:0@lo:103: 00000100:00100000:1.0:1788744557.366231:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475264896:0@lo:103: 00000100:00100000:1.0:1788744557.366258:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744557.366272:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475265408:0@lo:400: 00000100:00100000:1.0:1788744557.366297:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744557.366344:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475265408 00000100:00100000:1.0:1788744557.366350:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475265408 00000100:00100000:1.0:1788744557.366407:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788744557.366416:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475265408:12345-0@lo:400: 00000100:00100000:1.0:1788744557.366464:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475265408:12345-0@lo:400: Request processed in 50us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744557.366470:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788744557.366489:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788744557.366513:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c781880 x1875634475265408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744557.366524:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475265408:0@lo:400: 00000100:00100000:0.0:1788744557.366763:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744557.366780:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475265536:0@lo:400: 00000100:00100000:0.0:1788744557.366799:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744557.366831:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475264640 00000100:00100000:0.0:1788744557.366834:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475264640 00010000:00010000:0.0:1788744557.366851:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a238531800/0x4b162761eb391e98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391e91 expref: 17 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744557.366938:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475264768 00000100:00100000:0.0:1788744557.366942:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475264768 00010000:00010000:0.0:1788744557.366954:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a200031e00/0x4b162761eb391e52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391e4b expref: 18 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744557.366964:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475264896 00000100:00100000:0.0:1788744557.366966:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475264896 00010000:00010000:0.0:1788744557.366973:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a238530400/0x4b162761eb391e28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391e21 expref: 19 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744557.366981:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475265024 00000100:00100000:0.0:1788744557.366983:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475265024 00010000:00010000:0.0:1788744557.366990:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a201473000/0x4b162761eb391e7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391e75 expref: 20 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744557.366999:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788744557.367004:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+20:3309:x1875634475264640:12345-0@lo:103: 00010000:00010000:0.0:1788744557.367012:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744557.367016:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a238531800/0x4b162761eb391e98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391e91 expref: 20 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.367024:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a238531800/0x4b162761eb391e98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391e91 expref: 20 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.367038:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a238531800/0x4b162761eb391e98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391e91 expref: 20 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.367049:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744557.367081:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3309:x1875634475264640:12345-0@lo:103: Request processed in 76us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744557.367094:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788744557.367106:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788744557.367111:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+18:3309:x1875634475264768:12345-0@lo:103: 00000100:00100000:1.0:1788744557.367217:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744557.367226:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:754bab6b-7807-4d58-8a45-456ed56af02a+18:3307:x1875634475264896:12345-0@lo:103: 00010000:00010000:1.0:1788744557.367234:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744557.367239:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a238530400/0x4b162761eb391e28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391e21 expref: 18 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.367254:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a238530400/0x4b162761eb391e28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391e21 expref: 18 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.367264:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a238530400/0x4b162761eb391e28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391e21 expref: 18 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.367273:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744557.367303:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:754bab6b-7807-4d58-8a45-456ed56af02a+17:3307:x1875634475264896:12345-0@lo:103: Request processed in 78us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744557.367309:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744557.367321:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788744557.367327:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:754bab6b-7807-4d58-8a45-456ed56af02a+16:3308:x1875634475265024:12345-0@lo:103: 00010000:00010000:1.0:1788744557.367335:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744557.367339:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a201473000/0x4b162761eb391e7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391e75 expref: 16 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.367347:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a201473000/0x4b162761eb391e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391e75 expref: 16 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.367356:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a201473000/0x4b162761eb391e7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391e75 expref: 16 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.367364:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744557.367390:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:754bab6b-7807-4d58-8a45-456ed56af02a+15:3308:x1875634475265024:12345-0@lo:103: Request processed in 63us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744557.367409:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788744557.367434:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475264896:0@lo:103: 00010000:00010000:0.0:1788744557.367545:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744557.367551:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a200031e00/0x4b162761eb391e52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391e4b expref: 14 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.367558:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a200031e00/0x4b162761eb391e52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391e4b expref: 14 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.367568:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a200031e00/0x4b162761eb391e52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391e4b expref: 14 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.367578:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744557.367601:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+13:3309:x1875634475264768:12345-0@lo:103: Request processed in 490us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744557.367607:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788744557.367641:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475265152:0@lo:400: 00000100:00100000:0.0:1788744557.367667:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744557.367928:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634475265280:0@lo:400: 00000100:00100000:0.0:1788744557.368126:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475265664:0@lo:400: 00000100:00100000:0.0:1788744557.368172:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744557.368193:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475264768:0@lo:103: 00000100:00100000:0.0:1788744557.368202:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475264640:0@lo:103: 00000100:00100000:0.0:1788744557.368340:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475265024:0@lo:103: 00000100:00100000:2.0:1788744557.369004:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744557.371462:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c078700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475263232:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744557.373531:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475265664 00000100:00100000:2.0:1788744557.373543:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475265664 00000100:00100000:2.0:1788744557.373591:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788744557.373600:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475265664:12345-0@lo:400: 00000100:00100000:2.0:1788744557.373676:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475265664:12345-0@lo:400: Request processed in 78us (5503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744557.373682:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788744557.373704:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788744557.373732:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c780a80 x1875634475265664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744557.373746:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475265664:0@lo:400: 00000100:00100000:1.0:1788744557.374023:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475265536 00000100:00100000:1.0:1788744557.374040:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475265536 00000100:00100000:1.0:1788744557.374075:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475265152 00000100:00100000:1.0:1788744557.374078:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475265152 00000100:00100000:1.0:1788744557.374088:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475265280 00000100:00100000:1.0:1788744557.374090:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475265280 00000100:00100000:1.0:1788744557.374103:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788744557.374109:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475265536:12345-0@lo:400: 00000100:00100000:1.0:1788744557.374272:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475265536:12345-0@lo:400: Request processed in 162us (7470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744557.374278:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788744557.374291:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744557.374297:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475265152:12345-0@lo:400: 00000100:00100000:1.0:1788744557.374321:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475265152:12345-0@lo:400: Request processed in 26us (6655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744557.374326:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744557.374335:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788744557.374340:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634475265280:12345-0@lo:400: 00000100:00100000:1.0:1788744557.374361:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634475265280:12345-0@lo:400: Request processed in 22us (5359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744557.374366:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744557.374565:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744557.374587:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744557.374967:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744557.374988:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451124224 00000100:00100000:3.0:1788744557.374999:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451124224 00010000:00010000:3.0:1788744557.375022:0:7626:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a2027e6c00/0x4b162761eb391ef3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d3e expref: 10 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744557.375041:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451124352 00000100:00100000:3.0:1788744557.375043:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451124352 00010000:00010000:3.0:1788744557.375051:0:7626:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a23d17fa00/0x4b162761eb391eec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d37 expref: 11 pid: 5833 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744557.375064:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:3.0:1788744557.375070:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+11:2360:x1875634451124224:12345-192.168.201.6@tcp:103: 00010000:00010000:3.0:1788744557.375080:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744557.375085:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a2027e6c00/0x4b162761eb391ef3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d3e expref: 11 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.375096:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a2027e6c00/0x4b162761eb391ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d3e expref: 11 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.375113:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2027e6c00/0x4b162761eb391ef3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d3e expref: 11 pid: 5835 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.375257:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744557.375295:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2360:x1875634451124224:12345-192.168.201.6@tcp:103: Request processed in 224us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744557.375302:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:3.0:1788744557.375338:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1788744557.375344:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:2360:x1875634451124352:12345-192.168.201.6@tcp:103: 00010000:00010000:3.0:1788744557.375351:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744557.375355:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a23d17fa00/0x4b162761eb391eec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d37 expref: 9 pid: 5833 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.375369:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a23d17fa00/0x4b162761eb391eec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d37 expref: 9 pid: 5833 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.375379:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744557.375464:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:2360:x1875634451124352:12345-192.168.201.6@tcp:103: Request processed in 50us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744557.375472:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00010000:00010000:1.0:1788744557.375712:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a23d17fa00/0x4b162761eb391eec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d37 expref: 8 pid: 5833 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744557.375723:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c078000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8440:1875634475263360:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744557.375761:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788744557.375946:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744557.375972:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475265152:0@lo:400: 00000100:00100000:2.0:1788744557.375996:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634475265280:0@lo:400: 00000100:00100000:2.0:1788744557.376011:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451124480 00000100:00100000:2.0:1788744557.376015:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451124480 00000100:00100000:2.0:1788744557.376044:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 131 00000100:00100000:2.0:1788744557.376050:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+8:5602:x1875634451124480:12345-192.168.201.6@tcp:101: 00010000:00010000:2.0:1788744557.376059:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744557.376072:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a201473200/0x4b162761eb391f32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d54da0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744557.376088:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744557.376097:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93a201473200/0x4b162761eb391f32 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54da0 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.376299:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744557.376341:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744557.376343:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744557.376552:0:5834:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744557.376570:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a201473200/0x4b162761eb391f32 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54da0 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744557.376578:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a201473200, rc 0) 00000100:00100000:2.0:1788744557.376611:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:5602:x1875634451124480:12345-192.168.201.6@tcp:101: Request processed in 561us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744557.376617:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 131 00010000:00010000:1.0:1788744557.377807:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a238531600/0x4b162761eb391e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391e8a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.377841:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238531600 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1788744557.377846:0:8445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a238531600/0x4b162761eb391e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391e8a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.377854:0:8445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a238531600/0x4b162761eb391e83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391e8a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744557.377860:0:8445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a238531600/0x4b162761eb391e83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391e8a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744557.377866:0:8445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744557.377914:0:8445:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a238531600/0x4b162761eb391e83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e8a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.377920:0:8445:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744557.377944:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a238531600/0x4b162761eb391e83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e8a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.377951:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a238531600/0x4b162761eb391e83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e8a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.377968:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744557.377970:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744557.377972:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744557.378213:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475265792:0@lo:103: 00000100:00100000:2.0:1788744557.378267:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744557.378403:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475265792 00000100:00100000:1.0:1788744557.378410:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475265792 00010000:00010000:1.0:1788744557.378434:0:7626:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a238531400/0x4b162761eb391e8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391e83 expref: 13 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744557.378462:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788744557.378480:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:754bab6b-7807-4d58-8a45-456ed56af02a+13:3310:x1875634475265792:12345-0@lo:103: 00010000:00010000:1.0:1788744557.378493:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744557.378500:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a238531400/0x4b162761eb391e8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391e83 expref: 13 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.378512:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a238531400/0x4b162761eb391e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391e83 expref: 13 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.378526:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a238531400/0x4b162761eb391e8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391e83 expref: 13 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.378539:0:7626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.378548:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.378564:0:7626:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.378572:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.378578:0:7626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.378585:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.378591:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e7e00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744557.378594:0:7626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.378609:0:7626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.378640:0:7626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93a201473200/0x4b162761eb391f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54da0 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.378648:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a201473200/0x4b162761eb391f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54da0 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.378669:0:7626:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff93a201473200/0x4b162761eb391f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54da0 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744557.378680:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c078700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:MGS:7626:1875634475265920:192.168.201.6@tcp:105: 00000100:00100000:1.0:1788744557.378742:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20489e000 going to sleep for 11 seconds 00010000:00010000:1.0:1788744557.378771:0:8440:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744557.378780:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744557.380357:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475265536:0@lo:400: 00000100:00100000:3.0:1788744557.394376:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c078700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:MGS:7626:1875634475265920:192.168.201.6@tcp:105: 00010000:00010000:3.0:1788744557.394478:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.394493:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2027e7e00/0x4b162761eb391f2b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744557.394508:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744557.394582:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:754bab6b-7807-4d58-8a45-456ed56af02a+12:3310:x1875634475265792:12345-0@lo:103: Request processed in 16103us (16314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744557.394592:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788744557.394839:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475265792:0@lo:103: 00000100:00100000:0.0:1788744557.395157:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744557.395414:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451124608 00000100:00100000:2.0:1788744557.395422:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451124608 00000100:00100000:2.0:1788744557.395491:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 132 00000100:00100000:2.0:1788744557.395502:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:5602:x1875634451124608:12345-192.168.201.6@tcp:501: 00000100:00100000:2.0:1788744557.396542:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:5602:x1875634451124608:12345-192.168.201.6@tcp:501: Request processed in 1038us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744557.396552:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 132 00000100:00100000:0.0:1788744557.411546:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744557.411604:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451124736 00000100:00100000:2.0:1788744557.411614:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451124736 00000100:00100000:2.0:1788744557.411676:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 133 00000100:00100000:2.0:1788744557.411686:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:5602:x1875634451124736:12345-192.168.201.6@tcp:503: 00000100:00100000:2.0:1788744557.411918:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:5602:x1875634451124736:12345-192.168.201.6@tcp:503: Request processed in 232us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744557.411931:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 133 00000100:00100000:0.0:1788744557.433550:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744557.433639:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451124864 00000100:00100000:3.0:1788744557.433650:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451124864 00000100:00100000:3.0:1788744557.433704:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 134 00000100:00100000:3.0:1788744557.433712:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:6059:x1875634451124864:12345-192.168.201.6@tcp:502: 00000100:00100000:3.0:1788744557.433990:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:6059:x1875634451124864:12345-192.168.201.6@tcp:502: Request processed in 277us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744557.434007:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 134 00000100:00100000:0.0:1788744557.441008:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744557.441049:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451124992 00000100:00100000:2.0:1788744557.441060:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451124992 00000100:00100000:2.0:1788744557.441116:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 135 00000100:00100000:2.0:1788744557.441127:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:6059:x1875634451124992:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744557.441447:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:6059:x1875634451124992:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 321us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744557.441456:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 135 00000100:00100000:2.0:1788744557.449422:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744557.449472:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451125120 00000100:00100000:0.0:1788744557.449483:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451125120 00000100:00100000:0.0:1788744557.449536:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 136 00000100:00100000:0.0:1788744557.449547:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:5602:x1875634451125120:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744557.449564:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744557.449582:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a23d17e800/0x4b162761eb391f39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d54da7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.449610:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23d17e800/0x4b162761eb391f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54da7 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.449621:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a23d17e800/0x4b162761eb391f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54da7 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744557.449642:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17e800, rc 0) 00000100:00100000:0.0:1788744557.449702:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5602:x1875634451125120:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 157us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744557.449709:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 136 00000100:00100000:2.0:1788744557.454074:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744557.454185:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451125248 00000100:00100000:0.0:1788744557.454195:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451125248 00000100:00100000:0.0:1788744557.454245:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 137 00000100:00100000:0.0:1788744557.454255:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5602:x1875634451125248:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744557.454513:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5602:x1875634451125248:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 259us (447us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788744557.454523:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 137 00010000:00010000:3.0:1788744557.684451:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744557.877831:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744557.878025:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475266048:0@lo:13: 00000100:00100000:0.0:1788744557.878097:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744557.878177:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475266048 00000100:00100000:1.0:1788744557.878186:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475266048 00000100:00100000:1.0:1788744557.878236:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788744557.878246:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475266048:12345-0@lo:13: 00002000:00000024:1.0:1788744557.878281:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744557.878332:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475266048:12345-0@lo:13: Request processed in 88us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744557.878339:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788744557.878474:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a241d77100 x1875634475266048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744557.878497:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475266048:0@lo:13: 00000020:00000080:2.0:1788744558.180794:0:8494:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbb14f160 20000000:00000080:2.0:1788744558.180813:0:8494:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93a23c0ab800 uarg=0000000000000000 20000000:01000000:2.0:1788744558.180850:0:8494:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788744558.180856:0:8494:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788744558.180859:0:8494:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788744558.181803:0:8495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788744558.181961:0:8494:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788744558.185414:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788744558.185452:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788744558.185489:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788744558.185507:0:8494:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788744558.185527:0:8494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93a201473000/0x4b162761eb391f40 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744558.185545:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a200030c00/0x4b162761eb391d17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391d10 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744558.185562:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a2027e7400/0x4b162761eb391d79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391d72 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744558.185567:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a200030800/0x4b162761eb391e44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391e3d expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744558.185575:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a107e81e00/0x4b162761eb391f01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d6f expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744558.185583:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93a201473000/0x4b162761eb391f40 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744558.185633:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a107e81e00/0x4b162761eb391f01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d6f expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744558.185647:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93a107e81e00/0x4b162761eb391f01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d6f expref: 9 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744558.185659:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875634475266176:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744558.185741:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a200030800/0x4b162761eb391e44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391e3d expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744558.185747:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a200030800/0x4b162761eb391e44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391e3d expref: 11 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744558.185753:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875634475266304:0@lo:104: 00000100:00100000:2.0:1788744558.185782:0:8494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744558.185815:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a2027e7400/0x4b162761eb391d79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391d72 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744558.185830:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a2027e7400/0x4b162761eb391d79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391d72 expref: 11 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744558.185838:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875634475266432:0@lo:104: 00000100:00100000:2.0:1788744558.185861:0:8494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744558.185886:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a200030c00/0x4b162761eb391d17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391d10 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744558.185893:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a200030c00/0x4b162761eb391d17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391d10 expref: 11 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744558.185900:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875634475266560:0@lo:104: 00000100:00100000:2.0:1788744558.185916:0:8494:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20657ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744558.185979:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788744558.185997:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744558.186009:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475266304 00000100:00100000:1.0:1788744558.186014:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475266304 00000100:00100000:1.0:1788744558.186048:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475266432 00000100:00100000:1.0:1788744558.186051:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475266432 00000100:00100000:1.0:1788744558.186059:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475266560 00000100:00100000:1.0:1788744558.186062:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475266560 00000100:00100000:1.0:1788744558.186074:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788744558.186081:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+5:8494:x1875634475266304:12345-0@lo:104: 00010000:00010000:1.0:1788744558.186091:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a201473600/0x4b162761eb391e3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391e44 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186172:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788744558.186178:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+5:8494:x1875634475266304:12345-0@lo:104: Request processed in 98us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744558.186185:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788744558.186200:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788744558.186206:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a105206050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+4:8494:x1875634475266432:12345-0@lo:104: 00010000:00010000:1.0:1788744558.186214:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391d72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391d79 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186242:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788744558.186246:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a105206050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+4:8494:x1875634475266432:12345-0@lo:104: Request processed in 41us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744558.186325:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788744558.186359:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788744558.186367:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c078380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+3:8494:x1875634475266560:12345-0@lo:104: 00010000:00010000:1.0:1788744558.186379:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a238531e00/0x4b162761eb391d10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391d17 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186412:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788744558.186417:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c078380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:754bab6b-7807-4d58-8a45-456ed56af02a+3:8494:x1875634475266560:12345-0@lo:104: Request processed in 52us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744558.186423:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788744558.186441:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788744558.186446:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a201473600/0x4b162761eb391e3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391e44 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186453:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201473600 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1788744558.186457:0:8445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a201473600/0x4b162761eb391e3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391e44 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186465:0:8445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a201473600/0x4b162761eb391e3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391e44 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744558.186472:0:8445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a201473600/0x4b162761eb391e3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391e44 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744558.186478:0:8445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744558.186502:0:8445:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a201473600/0x4b162761eb391e3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e44 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186509:0:8445:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744558.186526:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a201473600/0x4b162761eb391e3d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e44 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186534:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a201473600/0x4b162761eb391e3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391e44 expref: -99 pid: 7620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186553:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744558.186556:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391d72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391d79 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186562:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238531a00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1788744558.186564:0:8445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391d72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391d79 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186571:0:8445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391d72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391d79 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744558.186578:0:8445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391d72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391d79 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744558.186583:0:8445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744558.186596:0:8445:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391d72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391d79 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186602:0:8445:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744558.186630:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391d72 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391d79 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186638:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a238531a00/0x4b162761eb391d72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391d79 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186647:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744558.186650:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a238531e00/0x4b162761eb391d10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391d17 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186665:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238531e00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1788744558.186669:0:8445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a238531e00/0x4b162761eb391d10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391d17 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186675:0:8445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a238531e00/0x4b162761eb391d10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391d17 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744558.186680:0:8445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a238531e00/0x4b162761eb391d10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391d17 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744558.186684:0:8445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744558.186697:0:8445:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a238531e00/0x4b162761eb391d10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391d17 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186701:0:8445:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744558.186706:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a238531e00/0x4b162761eb391d10 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391d17 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186712:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a238531e00/0x4b162761eb391d10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391d17 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.186722:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744558.186724:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744558.186726:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744558.186738:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c079500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475266688:0@lo:103: 00000100:00100000:1.0:1788744558.186764:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744558.186803:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475266816:0@lo:103: 00000100:00100000:1.0:1788744558.186823:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744558.186846:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744558.186851:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475266944:0@lo:103: 00000100:00100000:1.0:1788744558.186869:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744558.186894:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475266688 00000100:00100000:1.0:1788744558.186898:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475266688 00010000:00010000:1.0:1788744558.186916:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a200030800/0x4b162761eb391e44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391e3d expref: 12 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744558.186933:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475266816 00000100:00100000:1.0:1788744558.186935:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475266816 00010000:00010000:1.0:1788744558.186945:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a2027e7400/0x4b162761eb391d79 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391d72 expref: 13 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744558.186954:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475266944 00000100:00100000:1.0:1788744558.186956:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475266944 00010000:00010000:1.0:1788744558.186964:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a200030c00/0x4b162761eb391d17 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391d10 expref: 14 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744558.186976:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788744558.186983:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754bab6b-7807-4d58-8a45-456ed56af02a+14:3308:x1875634475266688:12345-0@lo:103: 00010000:00010000:1.0:1788744558.186992:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744558.186996:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a200030800/0x4b162761eb391e44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391e3d expref: 14 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.187004:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a200030800/0x4b162761eb391e44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391e3d expref: 14 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.187018:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744558.187045:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754bab6b-7807-4d58-8a45-456ed56af02a+14:3308:x1875634475266688:12345-0@lo:103: Request processed in 63us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744558.187051:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788744558.187070:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744558.187075:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754bab6b-7807-4d58-8a45-456ed56af02a+13:3309:x1875634475266816:12345-0@lo:103: 00010000:00010000:1.0:1788744558.187082:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744558.187086:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a2027e7400/0x4b162761eb391d79 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391d72 expref: 13 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.187094:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a2027e7400/0x4b162761eb391d79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391d72 expref: 13 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.187103:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744558.187155:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754bab6b-7807-4d58-8a45-456ed56af02a+13:3309:x1875634475266816:12345-0@lo:103: Request processed in 52us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744558.187162:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744558.187174:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788744558.187180:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754bab6b-7807-4d58-8a45-456ed56af02a+12:3309:x1875634475266944:12345-0@lo:103: 00010000:00010000:1.0:1788744558.187188:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744558.187192:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a200030c00/0x4b162761eb391d17 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391d10 expref: 12 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.187200:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a200030c00/0x4b162761eb391d17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391d10 expref: 12 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.187210:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744558.187230:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754bab6b-7807-4d58-8a45-456ed56af02a+12:3309:x1875634475266944:12345-0@lo:103: Request processed in 51us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744558.187236:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788744558.187463:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744558.187571:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a200030800/0x4b162761eb391e44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391e3d expref: 11 pid: 5835 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744558.187583:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875634475266304:0@lo:104: 00010000:00010000:2.0:1788744558.187594:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2027e7400/0x4b162761eb391d79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391d72 expref: 10 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744558.187601:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875634475266432:0@lo:104: 00010000:00010000:2.0:1788744558.187610:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a200030c00/0x4b162761eb391d17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391d10 expref: 9 pid: 5833 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744558.187627:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875634475266560:0@lo:104: 00000100:00100000:1.0:1788744558.187768:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c079500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475266688:0@lo:103: 00000100:00100000:1.0:1788744558.187792:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475266944:0@lo:103: 00000100:00100000:1.0:1788744558.187812:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475266816:0@lo:103: 00010000:00010000:0.0:1788744558.188177:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744558.192753:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744558.192868:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875634475266176:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788744558.192907:0:8494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93a201473000/0x4b162761eb391f40 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744558.193044:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451125376 00000100:00100000:1.0:1788744558.193052:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451125376 00010000:00010000:1.0:1788744558.193087:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a107e81e00/0x4b162761eb391f01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d6f expref: 10 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744558.193126:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:1.0:1788744558.193159:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2359:x1875634451125376:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744558.193176:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744558.193182:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a107e81e00/0x4b162761eb391f01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d6f expref: 10 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.193193:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a107e81e00/0x4b162761eb391f01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d6f expref: 10 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.193212:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a107e81e00/0x4b162761eb391f01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d6f expref: 10 pid: 5834 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.193226:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93a201473000/0x4b162761eb391f40 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.193234:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a201473000/0x4b162761eb391f40 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.193248:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a201473000/0x4b162761eb391f40 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.193366:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a201473000/0x4b162761eb391f40 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.193390:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93a201473000/0x4b162761eb391f40 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.193397:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93a201473000/0x4b162761eb391f40 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.193402:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201473000 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744558.193406:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93a201473000/0x4b162761eb391f40 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.193413:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93a201473000/0x4b162761eb391f40 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744558.195788:0:8494:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93a201473000/0x4b162761eb391f40 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744558.195802:0:8494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93a201473000/0x4b162761eb391f40 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.196204:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93a201473000/0x4b162761eb391f40 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.196214:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a201473000/0x4b162761eb391f40 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744558.196233:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744558.196962:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:2359:x1875634451125376:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 3797us (4212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744558.196974:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:1.0:1788744558.388329:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744558.388355:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475267072:0@lo:13: 00000100:00100000:1.0:1788744558.388423:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744558.388482:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475267072 00000100:00100000:1.0:1788744558.388490:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475267072 00000100:00100000:1.0:1788744558.388537:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788744558.388560:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475267072:12345-0@lo:13: 00002000:00000024:1.0:1788744558.388624:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744558.388670:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475267072:12345-0@lo:13: Request processed in 111us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744558.388678:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788744558.388735:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c07aa00 x1875634475267072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744558.388758:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475267072:0@lo:13: 00000100:00100000:3.0:1788744558.533240:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744558.533692:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451125504 00000100:00100000:2.0:1788744558.533727:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451125504 00000100:00100000:2.0:1788744558.533784:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 138 00000100:00100000:2.0:1788744558.533803:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:5602:x1875634451125504:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744558.533825:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744558.533851:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a201472e00/0x4b162761eb391f47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d54dae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744558.533889:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a201472e00/0x4b162761eb391f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54dae expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744558.533900:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a201472e00/0x4b162761eb391f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54dae expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744558.533910:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a201472e00, rc 0) 00000100:00100000:2.0:1788744558.533973:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5602:x1875634451125504:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 180us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744558.533981:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 138 00000100:00100000:3.0:1788744558.538992:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744558.539046:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451125632 00000100:00100000:0.0:1788744558.539055:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451125632 00000100:00100000:0.0:1788744558.539107:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 139 00000100:00100000:0.0:1788744558.539116:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5602:x1875634451125632:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744558.539932:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5602:x1875634451125632:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 813us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744558.539943:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 139 00000100:00100000:2.0:1788744558.556788:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744558.556902:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451125760 00000100:00100000:1.0:1788744558.556913:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451125760 00000100:00100000:1.0:1788744558.556968:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 140 00000100:00100000:1.0:1788744558.556979:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5602:x1875634451125760:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744558.557335:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:5602:x1875634451125760:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 356us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744558.557344:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 140 00000100:00100000:2.0:1788744558.574074:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744558.574429:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451125888 00000100:00100000:3.0:1788744558.574441:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451125888 00000100:00100000:3.0:1788744558.574517:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 141 00000100:00100000:3.0:1788744558.574527:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:6102:x1875634451125888:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788744558.574820:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:6102:x1875634451125888:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 294us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744558.574828:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 141 00000100:00100000:3.0:1788744558.579652:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744558.579832:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451126016 00000100:00100000:2.0:1788744558.579846:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451126016 00000100:00100000:2.0:1788744558.579911:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 142 00000100:00100000:2.0:1788744558.579922:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:6102:x1875634451126016:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744558.580231:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:6102:x1875634451126016:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 306us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744558.580241:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 142 00010000:00010000:0.0:1788744558.709507:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788744559.227058:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788744559.227069:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93a104b55800 from 39 10000000:01000000:0.0:1788744559.227077:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788744559.227126:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.227187:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.227199:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744559.227225:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475267200:0@lo:101: 00000100:00100000:0.0:1788744559.227290:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744559.227354:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2111f6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788744559.227420:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475267200 00000100:00100000:3.0:1788744559.227428:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475267200 00000100:00100000:3.0:1788744559.227485:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788744559.227494:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+9:5837:x1875634475267200:12345-0@lo:101: 00010000:00010000:3.0:1788744559.227508:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744559.227523:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e80400/0x4b162761eb391f55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391f4e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.227546:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e80400/0x4b162761eb391f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391f4e expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.227569:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e80400/0x4b162761eb391f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391f4e expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.227588:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80400, rc 0) 00000100:00100000:3.0:1788744559.227641:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+10:5837:x1875634475267200:12345-0@lo:101: Request processed in 148us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744559.227647:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788744559.227694:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475267200:0@lo:101: 00010000:00010000:3.0:1788744559.227709:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.227717:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391f55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744559.227785:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475267328:0@lo:501: 00000100:00100000:3.0:1788744559.227810:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744559.227824:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c9cab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744559.227836:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475267328 00000100:00100000:3.0:1788744559.227839:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475267328 00000100:00100000:3.0:1788744559.227861:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788744559.227868:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+10:5837:x1875634475267328:12345-0@lo:501: 00000100:00100000:3.0:1788744559.228120:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+10:5837:x1875634475267328:12345-0@lo:501: Request processed in 252us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744559.228149:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788744559.228180:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475267328:0@lo:501: 00000100:00100000:3.0:1788744559.228207:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475267456:0@lo:503: 00000100:00100000:3.0:1788744559.228247:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744559.228262:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c9cab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744559.228272:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475267456 00000100:00100000:3.0:1788744559.228276:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475267456 00000100:00100000:3.0:1788744559.228295:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788744559.228301:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+10:5837:x1875634475267456:12345-0@lo:503: 00000100:00100000:3.0:1788744559.228435:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+10:5837:x1875634475267456:12345-0@lo:503: Request processed in 133us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744559.228441:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788744559.228475:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475267456:0@lo:503: 00000100:00100000:3.0:1788744559.228687:0:8519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8519:1875634475267584:0@lo:502: 00000100:00100000:3.0:1788744559.228718:0:8519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744559.228735:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475267584 00000100:00100000:3.0:1788744559.228738:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475267584 00000100:00100000:3.0:1788744559.228760:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788744559.228766:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20791e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+10:8519:x1875634475267584:12345-0@lo:502: 00000100:00100000:3.0:1788744559.228915:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20791e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+10:8519:x1875634475267584:12345-0@lo:502: Request processed in 149us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744559.228923:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788744559.228950:0:8519:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c9ca6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744559.228963:0:8519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8519:1875634475267584:0@lo:502: 00000100:00100000:3.0:1788744559.228997:0:8519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8519:1875634475267712:0@lo:502: 00000100:00100000:3.0:1788744559.229028:0:8519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744559.229046:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475267712 00000100:00100000:3.0:1788744559.229049:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475267712 00000100:00100000:3.0:1788744559.229069:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788744559.229082:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20791e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+10:8519:x1875634475267712:12345-0@lo:502: 00000100:00100000:3.0:1788744559.229214:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20791e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+10:8519:x1875634475267712:12345-0@lo:502: Request processed in 134us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744559.229221:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788744559.229247:0:8519:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204971b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744559.229259:0:8519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8519:1875634475267712:0@lo:502: 00000040:00080000:3.0:1788744559.229277:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788744559.229322:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788744559.229337:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788744559.229345:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.229354:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744559.229364:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788744559.229366:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788744559.229369:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788744559.229387:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.229395:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.229403:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744559.229414:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475267840:0@lo:101: 00000100:00100000:3.0:1788744559.229439:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744559.229459:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c9ca840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744559.229469:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475267840 00000100:00100000:3.0:1788744559.229473:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475267840 00000100:00100000:3.0:1788744559.229492:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788744559.229497:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20791dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+10:5837:x1875634475267840:12345-0@lo:101: 00010000:00010000:3.0:1788744559.229504:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744559.229514:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e81000/0x4b162761eb391f63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391f5c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.229531:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e81000/0x4b162761eb391f63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391f5c expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.229540:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e81000/0x4b162761eb391f63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391f5c expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.229548:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81000, rc 0) 00000100:00100000:3.0:1788744559.229574:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20791dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:5837:x1875634475267840:12345-0@lo:101: Request processed in 77us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744559.229580:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788744559.229623:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475267840:0@lo:101: 00010000:00010000:3.0:1788744559.229634:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f63 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.229642:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391f63 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744559.229675:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475267968:0@lo:501: 00000100:00100000:3.0:1788744559.229697:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744559.229709:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204971180 going to sleep for 11 seconds 00000100:00100000:3.0:1788744559.229725:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475267968 00000100:00100000:3.0:1788744559.229729:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475267968 00000100:00100000:3.0:1788744559.229747:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788744559.229753:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20791cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:5837:x1875634475267968:12345-0@lo:501: 00000100:00100000:3.0:1788744559.229909:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20791cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:5837:x1875634475267968:12345-0@lo:501: Request processed in 155us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744559.229916:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788744559.229943:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475267968:0@lo:501: 00000100:00100000:3.0:1788744559.229965:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475268096:0@lo:503: 00000100:00100000:3.0:1788744559.229996:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744559.230008:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204971180 going to sleep for 11 seconds 00000100:00100000:3.0:1788744559.230018:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475268096 00000100:00100000:3.0:1788744559.230021:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475268096 00000100:00100000:3.0:1788744559.230040:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788744559.230046:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:5837:x1875634475268096:12345-0@lo:503: 00000100:00100000:3.0:1788744559.230175:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:5837:x1875634475268096:12345-0@lo:503: Request processed in 129us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744559.230181:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788744559.230216:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475268096:0@lo:503: 00000100:00100000:1.0:1788744559.236956:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8520:1875634475268224:0@lo:502: 00000100:00100000:1.0:1788744559.237043:0:8520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744559.237096:0:8520:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20489e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.237169:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475268224 00000100:00100000:0.0:1788744559.237187:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475268224 00000100:00100000:0.0:1788744559.237232:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788744559.237240:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:8520:x1875634475268224:12345-0@lo:502: 00000100:00100000:0.0:1788744559.237461:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+11:8520:x1875634475268224:12345-0@lo:502: Request processed in 221us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.237469:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788744559.237672:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8520:1875634475268224:0@lo:502: 00000020:01000000:1.0:1788744559.237697:0:8520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744559.237706:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744559.237709:0:8520:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788744559.237713:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788744559.237734:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8520:1875634475268352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744559.237834:0:8520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744559.237901:0:8520:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20489e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.239470:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475268352 00000100:00100000:0.0:1788744559.239480:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475268352 00000100:00100000:0.0:1788744559.241147:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788744559.241167:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+11:8520:x1875634475268352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744559.247411:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+11:8520:x1875634475268352:12345-0@lo:502:llog_process_th.0 Request processed in 6242us (9565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.247424:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788744559.247557:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8520:1875634475268352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788744559.247589:0:8520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744559.247606:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744559.247609:0:8520:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788744559.247613:0:8520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788744559.248204:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788744559.248223:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788744559.248234:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f63 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.248253:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f63 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744559.248263:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788744559.248266:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a104b55800 from 4 10000000:01000000:0.0:1788744559.248268:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744559.248301:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17ee00/0x4b162761eb391f6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.248308:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23d17ee00/0x4b162761eb391f6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.248317:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23d17ee00/0x4b162761eb391f6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744559.248343:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475268480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.248383:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744559.248419:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2111f6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.248436:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475268480 00000100:00100000:0.0:1788744559.248442:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475268480 00000100:00100000:0.0:1788744559.248479:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788744559.248487:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+11:5837:x1875634475268480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744559.248501:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744559.248514:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a23d17f600/0x4b162761eb391f71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391f6a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.248536:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23d17f600/0x4b162761eb391f71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391f6a expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.248558:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a23d17f600/0x4b162761eb391f71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391f6a expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.248568:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17f600, rc 0) 00000100:00100000:0.0:1788744559.248611:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:5837:x1875634475268480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.248617:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788744559.248648:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475268480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744559.248661:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23d17ee00/0x4b162761eb391f6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f71 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.248669:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23d17ee00/0x4b162761eb391f6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391f71 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744559.248710:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475268608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.248731:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744559.248745:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2111f6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.248756:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475268608 00000100:00100000:0.0:1788744559.248760:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475268608 00000100:00100000:0.0:1788744559.248778:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788744559.248784:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:5837:x1875634475268608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.249008:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:5837:x1875634475268608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.249015:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788744559.249045:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475268608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.249081:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475268736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.249113:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744559.249127:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2320c5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.249160:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475268736 00000100:00100000:0.0:1788744559.249163:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475268736 00000100:00100000:0.0:1788744559.249184:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788744559.249190:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:5837:x1875634475268736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.249318:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:5837:x1875634475268736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.249325:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788744559.249360:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475268736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.269759:0:8521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8521:1875634475268864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744559.269843:0:8521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744559.270725:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475268864 00000100:00100000:0.0:1788744559.270734:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475268864 00000100:00100000:0.0:1788744559.270781:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788744559.270791:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:8521:x1875634475268864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744559.271038:0:8521:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20657e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.273573:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+12:8521:x1875634475268864:12345-0@lo:502:llog_process_th.0 Request processed in 2774us (3721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.273586:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788744559.273711:0:8521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8521:1875634475268864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744559.273752:0:8521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744559.273762:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744559.273764:0:8521:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788744559.273770:0:8521:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93a104b55800 00000020:00000080:2.0:1788744559.273773:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788744559.273870:0:8521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8521:1875634475268992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744559.273928:0:8521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744559.273972:0:8521:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a229cbab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.274206:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475268992 00000100:00100000:0.0:1788744559.274214:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475268992 00000100:00100000:0.0:1788744559.274254:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788744559.274263:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+12:8521:x1875634475268992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744559.274473:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+12:8521:x1875634475268992:12345-0@lo:502:llog_process_th.0 Request processed in 211us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.274480:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788744559.274627:0:8521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8521:1875634475268992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744559.274648:0:8521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744559.274653:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744559.274654:0:8521:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788744559.274658:0:8521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788744559.274809:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788744559.274827:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744559.274836:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17ee00/0x4b162761eb391f6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f71 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.274846:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23d17ee00/0x4b162761eb391f6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f71 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744559.274857:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788744559.274859:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93a210e7e800 from 39 10000000:01000000:0.0:1788744559.274862:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788744559.274898:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.274906:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.274915:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744559.274930:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475269120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.274959:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744559.275280:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23ccd69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744559.275803:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475269120 00000100:00100000:2.0:1788744559.275810:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475269120 00000100:00100000:2.0:1788744559.275846:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788744559.275854:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+12:5837:x1875634475269120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744559.275866:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744559.275976:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a201472c00/0x4b162761eb391f7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391f78 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.278192:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a201472c00/0x4b162761eb391f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391f78 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.278212:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a201472c00/0x4b162761eb391f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391f78 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.278228:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a201472c00, rc 0) 00000100:00100000:2.0:1788744559.278324:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:5837:x1875634475269120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2459us (3351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744559.278333:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788744559.278977:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475269120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744559.279015:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.279027:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391f7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744559.279121:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475269248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.279181:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744559.279210:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23ccd69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744559.279541:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475269248 00000100:00100000:2.0:1788744559.279547:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475269248 00000100:00100000:2.0:1788744559.279585:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788744559.279605:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+13:5837:x1875634475269248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.279845:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+13:5837:x1875634475269248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744559.279852:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788744559.279901:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475269248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.279938:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475269376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.279974:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744559.280125:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203395d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744559.280343:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475269376 00000100:00100000:3.0:1788744559.280349:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475269376 00000100:00100000:3.0:1788744559.280380:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788744559.280388:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:5837:x1875634475269376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744559.280536:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+13:5837:x1875634475269376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744559.280542:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788744559.280643:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475269376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744559.280834:0:8524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8524:1875634475269504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744559.280866:0:8524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744559.280881:0:8524:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23cde2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744559.281810:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475269504 00000100:00100000:2.0:1788744559.281818:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475269504 00000100:00100000:2.0:1788744559.281849:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788744559.281856:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+13:8524:x1875634475269504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744559.282207:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+13:8524:x1875634475269504:12345-0@lo:502:llog_process_th.0 Request processed in 350us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744559.282214:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788744559.282294:0:8524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8524:1875634475269504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744559.282338:0:8524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8524:1875634475269632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744559.282372:0:8524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744559.282403:0:8524:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23cde2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744559.282569:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475269632 00000100:00100000:2.0:1788744559.282573:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475269632 00000100:00100000:2.0:1788744559.282618:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788744559.282625:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+13:8524:x1875634475269632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744559.282747:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+13:8524:x1875634475269632:12345-0@lo:502:llog_process_th.0 Request processed in 122us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744559.282754:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788744559.282787:0:8524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8524:1875634475269632:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788744559.282805:0:8524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788744559.282850:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788744559.282868:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788744559.282901:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.282913:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744559.282921:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788744559.282924:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788744559.282927:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788744559.282949:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.282958:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.282966:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744559.282979:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475269760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.283101:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744559.283116:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203395840 going to sleep for 11 seconds 00000100:00100000:2.0:1788744559.283147:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475269760 00000100:00100000:2.0:1788744559.283151:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475269760 00000100:00100000:2.0:1788744559.283172:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788744559.283179:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+13:5837:x1875634475269760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744559.283189:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744559.283204:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a201473600/0x4b162761eb391f8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391f86 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.283230:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a201473600/0x4b162761eb391f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391f86 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.283240:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a201473600/0x4b162761eb391f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391f86 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.283249:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a201473600, rc 0) 00000100:00100000:2.0:1788744559.283278:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+14:5837:x1875634475269760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744559.283283:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788744559.283376:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475269760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744559.283390:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f8d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.283398:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391f8d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744559.283441:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475269888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.283469:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744559.283499:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203395840 going to sleep for 11 seconds 00000100:00100000:2.0:1788744559.283510:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475269888 00000100:00100000:2.0:1788744559.283514:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475269888 00000100:00100000:2.0:1788744559.283547:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788744559.283553:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+14:5837:x1875634475269888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.283769:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+14:5837:x1875634475269888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744559.283776:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788744559.283804:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475269888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.283828:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475270016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.283858:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744559.283871:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203395840 going to sleep for 11 seconds 00000100:00100000:2.0:1788744559.283881:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475270016 00000100:00100000:2.0:1788744559.283884:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475270016 00000100:00100000:2.0:1788744559.283901:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788744559.283906:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+14:5837:x1875634475270016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.284504:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+14:5837:x1875634475270016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 596us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744559.284511:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788744559.284632:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475270016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.285352:0:8525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8525:1875634475270144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744559.285389:0:8525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744559.285413:0:8525:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2033959c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.286287:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475270144 00000100:00100000:0.0:1788744559.286296:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475270144 00000100:00100000:0.0:1788744559.286342:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788744559.286351:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+14:8525:x1875634475270144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744559.286553:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+14:8525:x1875634475270144:12345-0@lo:502:llog_process_th.0 Request processed in 203us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.286560:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788744559.286690:0:8525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8525:1875634475270144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744559.286717:0:8525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744559.286731:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744559.286734:0:8525:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788744559.286740:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788744559.286763:0:8525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8525:1875634475270272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744559.286795:0:8525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744559.286831:0:8525:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2033959c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.286987:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475270272 00000100:00100000:0.0:1788744559.286992:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475270272 00000100:00100000:0.0:1788744559.287021:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788744559.287028:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+14:8525:x1875634475270272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744559.293520:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+14:8525:x1875634475270272:12345-0@lo:502:llog_process_th.0 Request processed in 6479us (6711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.293537:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788744559.293569:0:8525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8525:1875634475270272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744559.293620:0:8525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744559.293628:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744559.293630:0:8525:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788744559.293635:0:8525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788744559.295298:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788744559.295326:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788744559.295337:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f8d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.295350:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f8d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744559.295369:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788744559.295372:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a210e7e800 from 4 10000000:01000000:0.0:1788744559.295374:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744559.295408:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17ec00/0x4b162761eb391f94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.295416:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23d17ec00/0x4b162761eb391f94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.295426:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23d17ec00/0x4b162761eb391f94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744559.295447:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475270400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.295505:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744559.295541:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23ccd66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.295559:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475270400 00000100:00100000:0.0:1788744559.295565:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475270400 00000100:00100000:0.0:1788744559.295616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788744559.295625:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+14:5837:x1875634475270400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744559.295637:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744559.295648:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a23d17f800/0x4b162761eb391f9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391f94 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.295670:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23d17f800/0x4b162761eb391f9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391f94 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.295681:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a23d17f800/0x4b162761eb391f9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391f94 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.295701:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17f800, rc 0) 00000100:00100000:0.0:1788744559.295736:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475270400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.295743:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788744559.295783:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475270400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744559.295795:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23d17ec00/0x4b162761eb391f94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f9b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.295805:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23d17ec00/0x4b162761eb391f94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391f9b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744559.295849:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475270528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.295871:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744559.295884:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23ccd66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.295896:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475270528 00000100:00100000:0.0:1788744559.295899:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475270528 00000100:00100000:0.0:1788744559.295920:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788744559.295926:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475270528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.299714:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475270528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.299732:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788744559.300319:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475270528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.300859:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475270656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.300926:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744559.300974:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23ccd66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.301010:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475270656 00000100:00100000:0.0:1788744559.301017:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475270656 00000100:00100000:0.0:1788744559.301059:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788744559.301068:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475270656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.302765:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475270656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1694us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.302774:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788744559.303653:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475270656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.305853:0:8529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8529:1875634475270784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744559.305938:0:8529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744559.305977:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475270784 00000100:00100000:2.0:1788744559.306108:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475270784 00000100:00100000:2.0:1788744559.306168:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788744559.306177:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+15:8529:x1875634475270784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744559.306442:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+15:8529:x1875634475270784:12345-0@lo:502:llog_process_th.0 Request processed in 266us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744559.306449:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788744559.306495:0:8529:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203395900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744559.306514:0:8529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8529:1875634475270784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744559.306755:0:8529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744559.306764:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744559.306767:0:8529:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788744559.306773:0:8529:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93a210e7e800 00000020:00000080:2.0:1788744559.306776:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788744559.306855:0:8529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8529:1875634475270912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744559.307114:0:8529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744559.307168:0:8529:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203395900 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.307755:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475270912 00000100:00100000:0.0:1788744559.307764:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475270912 00000100:00100000:0.0:1788744559.307810:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788744559.307819:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+15:8529:x1875634475270912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744559.308001:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+15:8529:x1875634475270912:12345-0@lo:502:llog_process_th.0 Request processed in 183us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.308009:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788744559.309719:0:8529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8529:1875634475270912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744559.309761:0:8529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744559.309769:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744559.309771:0:8529:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788744559.309775:0:8529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788744559.313395:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788744559.313430:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744559.313441:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17ec00/0x4b162761eb391f94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f9b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.313454:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23d17ec00/0x4b162761eb391f94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f9b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744559.313464:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788744559.313467:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93a203f6f000 from 39 10000000:01000000:0.0:1788744559.313469:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788744559.313507:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.313530:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.313541:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744559.313567:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475271040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.313645:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744559.313684:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23ccd6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744559.314581:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475271040 00000100:00100000:2.0:1788744559.314590:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475271040 00000100:00100000:2.0:1788744559.314644:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788744559.314653:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+15:5837:x1875634475271040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744559.314668:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744559.314683:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a201473c00/0x4b162761eb391fa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391fa2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.314709:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a201473c00/0x4b162761eb391fa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391fa2 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.314720:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a201473c00/0x4b162761eb391fa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391fa2 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.314730:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a201473c00, rc 0) 00000100:00100000:2.0:1788744559.314792:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475271040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744559.314799:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788744559.314850:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475271040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744559.314866:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391fa9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.314898:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391fa9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744559.314957:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475271168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.314987:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744559.315010:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203395600 going to sleep for 11 seconds 00000100:00100000:2.0:1788744559.315024:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475271168 00000100:00100000:2.0:1788744559.315027:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475271168 00000100:00100000:2.0:1788744559.315048:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788744559.315054:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475271168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.315300:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475271168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744559.315308:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788744559.315499:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475271168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.315526:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475271296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.315572:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744559.315590:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203395600 going to sleep for 11 seconds 00000100:00100000:2.0:1788744559.315612:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475271296 00000100:00100000:2.0:1788744559.315616:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475271296 00000100:00100000:2.0:1788744559.315635:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788744559.315640:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475271296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.315771:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475271296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744559.315778:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788744559.315816:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475271296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.319058:0:8530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8530:1875634475271424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744559.319192:0:8530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744559.319245:0:8530:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23ccd6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744559.319385:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475271424 00000100:00100000:3.0:1788744559.319393:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475271424 00000100:00100000:3.0:1788744559.319438:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788744559.319447:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+16:8530:x1875634475271424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744559.319712:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+16:8530:x1875634475271424:12345-0@lo:502:llog_process_th.0 Request processed in 265us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744559.319720:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788744559.320351:0:8530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8530:1875634475271424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744559.320405:0:8530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8530:1875634475271552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744559.320442:0:8530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744559.320481:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475271552 00000100:00100000:0.0:1788744559.320486:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475271552 00000100:00100000:0.0:1788744559.320508:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788744559.320514:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+16:8530:x1875634475271552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744559.320672:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+16:8530:x1875634475271552:12345-0@lo:502:llog_process_th.0 Request processed in 157us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.320679:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788744559.320879:0:8530:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23ccd6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.320893:0:8530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8530:1875634475271552:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788744559.320920:0:8530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788744559.321324:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788744559.321356:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788744559.321366:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391fa9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.321377:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391fa9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744559.321387:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788744559.321390:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788744559.321393:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788744559.321423:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.321430:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.321438:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744559.321453:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475271680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744559.321483:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744559.321497:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.324999:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475271680 00000100:00100000:0.0:1788744559.325015:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475271680 00000100:00100000:0.0:1788744559.325059:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788744559.325069:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475271680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744559.325084:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744559.325101:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a23d17fe00/0x4b162761eb391fb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391fb0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.325143:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23d17fe00/0x4b162761eb391fb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391fb0 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.325154:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a23d17fe00/0x4b162761eb391fb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391fb0 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.325162:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17fe00, rc 0) 00000100:00100000:0.0:1788744559.325231:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475271680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (3747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.325237:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788744559.326589:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475271680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744559.326621:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391fb7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.326633:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391fb7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744559.326704:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475271808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744559.326748:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744559.326933:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.327709:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475271808 00000100:00100000:0.0:1788744559.327719:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475271808 00000100:00100000:1.0:1788744559.327857:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788744559.327867:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475271808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744559.328243:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475271808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 376us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744559.328250:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788744559.328632:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475271808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744559.328675:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475271936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744559.328714:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744559.328830:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744559.328858:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475271936 00000100:00100000:1.0:1788744559.328863:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475271936 00000100:00100000:1.0:1788744559.328920:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788744559.328929:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475271936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744559.329092:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475271936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744559.329099:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788744559.329195:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475271936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744559.329382:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8532:1875634475272064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744559.329414:0:8532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744559.329955:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475272064 00000100:00100000:0.0:1788744559.329960:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475272064 00000100:00100000:0.0:1788744559.329985:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788744559.329993:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+17:8532:x1875634475272064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744559.330199:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+17:8532:x1875634475272064:12345-0@lo:502:llog_process_th.0 Request processed in 206us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.330206:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788744559.332296:0:8532:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4780 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.332332:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8532:1875634475272064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744559.332380:0:8532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744559.332391:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744559.332394:0:8532:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788744559.332400:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788744559.332446:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8532:1875634475272192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744559.332509:0:8532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744559.332542:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475272192 00000100:00100000:0.0:1788744559.332548:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475272192 00000100:00100000:0.0:1788744559.332606:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788744559.332616:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+17:8532:x1875634475272192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744559.332962:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+17:8532:x1875634475272192:12345-0@lo:502:llog_process_th.0 Request processed in 346us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.332970:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788744559.333008:0:8532:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23ccd66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.333020:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8532:1875634475272192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744559.333038:0:8532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744559.333042:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744559.333043:0:8532:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788744559.333046:0:8532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788744559.341470:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788744559.341508:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788744559.341521:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391fb7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.341545:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391fb7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744559.341556:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788744559.341558:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a203f6f000 from 4 10000000:01000000:2.0:1788744559.341561:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744559.341610:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201473000/0x4b162761eb391fbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.341618:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a201473000/0x4b162761eb391fbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.341629:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a201473000/0x4b162761eb391fbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744559.341655:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475272320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.341720:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744559.341761:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2033959c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744559.342679:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475272320 00000100:00100000:3.0:1788744559.342690:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475272320 00000100:00100000:3.0:1788744559.343253:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788744559.343265:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475272320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744559.343280:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744559.343295:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e81c00/0x4b162761eb391fc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391fbe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.343320:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e81c00/0x4b162761eb391fc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391fbe expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.343330:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e81c00/0x4b162761eb391fc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391fbe expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.343338:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81c00, rc 0) 00000100:00100000:3.0:1788744559.343410:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475272320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744559.343417:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788744559.343433:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475272320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744559.343449:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a201473000/0x4b162761eb391fbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391fc5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744559.343457:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a201473000/0x4b162761eb391fbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391fc5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744559.343528:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475272448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.343970:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744559.344168:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2033959c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744559.344567:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475272448 00000100:00100000:0.0:1788744559.344573:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475272448 00000100:00100000:0.0:1788744559.344616:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788744559.344624:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475272448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744559.346301:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475272448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1671us (2324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744559.346322:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788744559.352618:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475272448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744559.352685:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475272576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744559.352756:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744559.352799:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4540 going to sleep for 11 seconds 00000100:00100000:2.0:1788744559.358551:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475272576 00000100:00100000:2.0:1788744559.358568:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475272576 00000100:00100000:2.0:1788744559.358644:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788744559.358653:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475272576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744559.359480:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475272576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 826us (6722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744559.359489:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788744559.359570:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475272576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744559.361308:0:8535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8535:1875634475272704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744559.361402:0:8535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744559.361452:0:8535:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20489e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744559.361965:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475272704 00000100:00100000:2.0:1788744559.361973:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475272704 00000100:00100000:2.0:1788744559.362022:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788744559.362032:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a203d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+18:8535:x1875634475272704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744559.362284:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a203d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+18:8535:x1875634475272704:12345-0@lo:502:llog_process_th.0 Request processed in 252us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744559.362292:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788744559.365350:0:8535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8535:1875634475272704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744559.365468:0:8535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744559.365486:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744559.365488:0:8535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788744559.365495:0:8535:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93a203f6f000 00000020:00000080:3.0:1788744559.365497:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788744559.365606:0:8535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d75500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8535:1875634475272832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744559.365673:0:8535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744559.365705:0:8535:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788744559.366430:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475272832 00000100:00100000:2.0:1788744559.366440:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475272832 00000100:00100000:2.0:1788744559.366488:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788744559.366497:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a203d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+18:8535:x1875634475272832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744559.366740:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a203d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+18:8535:x1875634475272832:12345-0@lo:502:llog_process_th.0 Request processed in 243us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744559.366755:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788744559.367315:0:8535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d75500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:8535:1875634475272832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744559.367344:0:8535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744559.367351:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744559.367353:0:8535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788744559.367357:0:8535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788744559.368048:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788744559.368163:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744559.368174:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201473000/0x4b162761eb391fbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391fc5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744559.368199:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a201473000/0x4b162761eb391fbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391fc5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744559.368209:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788744559.368211:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93a207434d40 from 1 10000000:01000000:1.0:1788744559.368214:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788744559.368248:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391fcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744559.368255:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391fcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744559.368264:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391fcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744559.368284:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c079500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475272960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744559.368334:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744559.368701:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475272960 00000100:00100000:3.0:1788744559.368708:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475272960 00000100:00100000:3.0:1788744559.368750:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788744559.368759:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475272960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744559.368771:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744559.368785:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e80200/0x4b162761eb391fd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb391fcc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.368807:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e80200/0x4b162761eb391fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb391fcc expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.368818:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e80200/0x4b162761eb391fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391fcc expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.368826:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80200, rc 0) 00000100:00100000:3.0:1788744559.368859:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:5837:x1875634475272960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744559.368875:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788744559.369187:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20489eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744559.369208:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c079500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475272960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744559.369221:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391fcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391fd3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744559.369229:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391fcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391fd3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744559.369283:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c079500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475273088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744559.369309:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744559.369339:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20489eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744559.369462:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475273088 00000100:00100000:3.0:1788744559.369466:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475273088 00000100:00100000:3.0:1788744559.369497:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788744559.369506:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:5837:x1875634475273088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744559.369751:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:5837:x1875634475273088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (440us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744559.369758:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788744559.369790:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c079500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475273088:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788744559.369813:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788744559.369819:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391fcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391fd3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744559.369827:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391fd3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744559.738437:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744560.038381:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744560.039987:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744560.040027:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744560.040070:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744560.040108:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451126400 00000100:00100000:0.0:1788744560.040118:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451126400 00000100:00100000:2.0:1788744560.040263:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451126272 00000100:00100000:2.0:1788744560.040268:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451126272 00000100:00100000:2.0:1788744560.040315:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:2.0:1788744560.040326:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451126272:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744560.040399:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451126272:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 75us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744560.040406:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:0.0:1788744560.040640:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451126528 00000100:00100000:0.0:1788744560.040644:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451126528 00000100:00100000:0.0:1788744560.040662:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1788744560.040670:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2362:x1875634451126400:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744560.040706:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2362:x1875634451126400:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 37us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744560.040712:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1788744560.040725:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1788744560.040730:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2362:x1875634451126528:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744560.040750:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2362:x1875634451126528:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 21us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744560.040755:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00080000:0.0:1788744560.040950:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744560.040955:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744560.040958:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744560.049047:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451126144 00000100:00100000:3.0:1788744560.049066:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451126144 00000100:00100000:1.0:1788744560.049274:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 190 00000100:00100000:1.0:1788744560.049286:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2362:x1875634451126144:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744560.049366:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2362:x1875634451126144:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 83us (10995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744560.049373:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 190 00010000:00010000:0.0:1788744560.758727:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744561.784216:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744562.484500:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475273344:0@lo:400:kworker.0 00000100:00100000:2.0:1788744562.484582:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744562.484637:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475273856:0@lo:400:kworker.0 00000100:00100000:2.0:1788744562.484661:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744562.484693:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744562.484700:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475273472:0@lo:400:kworker.0 00000100:00100000:2.0:1788744562.484721:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744562.484754:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475273344 00000100:00100000:2.0:1788744562.484761:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475273344 00000100:00100000:2.0:1788744562.484802:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475273472 00000100:00100000:2.0:1788744562.484805:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475273472 00000100:00100000:2.0:1788744562.484830:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788744562.484838:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475273344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744562.484888:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475273344:12345-0@lo:400:kworker.0 Request processed in 50us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744562.484896:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788744562.484916:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788744562.484922:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475273472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744562.484975:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475273472:12345-0@lo:400:kworker.0 Request processed in 53us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744562.484982:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788744562.485002:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475273856 00000100:00100000:2.0:1788744562.485006:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475273856 00000100:00100000:0.0:1788744562.485051:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475273600:0@lo:400:kworker.0 00000100:00100000:0.0:1788744562.485081:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744562.485110:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788744562.485116:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475273216:0@lo:400:kworker.0 00000100:00100000:0.0:1788744562.485163:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744562.485198:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475273728:0@lo:400:kworker.0 00000100:00100000:0.0:1788744562.485221:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788744562.485274:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744562.485285:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475273728 00000100:00100000:0.0:1788744562.485289:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475273728 00000100:00100000:0.0:1788744562.485315:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788744562.485321:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475273728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744562.485356:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475273728:12345-0@lo:400:kworker.0 Request processed in 36us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744562.485362:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788744562.485379:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744562.485404:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475273728:0@lo:400:kworker.0 00000100:00100000:0.0:1788744562.485426:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475273472:0@lo:400:kworker.0 00000100:00100000:0.0:1788744562.485434:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475273344:0@lo:400:kworker.0 00000100:00100000:0.0:1788744562.485457:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475273216 00000100:00100000:0.0:1788744562.485459:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475273216 00000100:00100000:0.0:1788744562.485475:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788744562.485479:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475273216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744562.485501:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475273216:12345-0@lo:400:kworker.0 Request processed in 22us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744562.485505:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788744562.485521:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475273600 00000100:00100000:0.0:1788744562.485523:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475273600 00000100:00100000:0.0:1788744562.485566:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788744562.485572:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475273600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744562.485601:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475273600:12345-0@lo:400:kworker.0 Request processed in 30us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744562.485607:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788744562.485619:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744562.485633:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475273216:0@lo:400:kworker.0 00010000:00080000:0.0:1788744562.485650:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a106fb7480 x1875634475273600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744562.485660:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475273600:0@lo:400:kworker.0 00000100:00080000:0.0:1788744562.485680:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744562.485690:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744562.485697:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475273856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744562.485739:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475273856:12345-0@lo:400:kworker.0 Request processed in 42us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744562.485745:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788744562.486375:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a106fb6a00 x1875634475273856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744562.486387:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475273856:0@lo:400:kworker.0 00010000:00010000:3.0:1788744562.804379:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744562.996542:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744562.996568:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475273984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744562.996646:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744562.997462:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475273984 00000100:00100000:3.0:1788744562.997471:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475273984 00000100:00100000:3.0:1788744562.997537:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744562.997548:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475273984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744562.997585:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744562.997640:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475273984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744562.997665:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788744562.997787:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a241d75500 x1875634475273984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744578 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744562.997807:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475273984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744563.509286:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475274112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744563.509358:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744563.509466:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475274112 00000100:00100000:3.0:1788744563.509474:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475274112 00000100:00100000:3.0:1788744563.509536:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744563.509546:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475274112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744563.509582:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744563.511889:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475274112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2337us (2523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744563.511902:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788744563.512766:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c07a300 x1875634475274112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744563.512856:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475274112:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788744563.835882:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744564.860417:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788744564.879939:0:8800:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1788744565.158593:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744565.158643:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744565.158683:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744565.158755:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744565.158786:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451126784 00000100:00100000:2.0:1788744565.158796:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451126784 00000100:00100000:3.0:1788744565.158834:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451126656 00000100:00100000:3.0:1788744565.158839:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451126656 00000100:00100000:2.0:1788744565.158879:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:3.0:1788744565.158882:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451127040 00000100:00100000:3.0:1788744565.158885:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451127040 00000100:00100000:2.0:1788744565.158891:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2361:x1875634451126784:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744565.158911:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451126912 00000100:00100000:3.0:1788744565.158914:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451126912 00000100:00100000:3.0:1788744565.158929:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1788744565.158936:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2361:x1875634451127040:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744565.158983:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2361:x1875634451127040:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 47us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744565.158983:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2361:x1875634451126784:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 93us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744565.158991:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:2.0:1788744565.159008:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:3.0:1788744565.159012:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:3.0:1788744565.159018:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2361:x1875634451126912:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744565.159042:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2361:x1875634451126912:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 24us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744565.159048:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00080000:0.0:1788744565.159476:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744565.159482:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744565.159485:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744565.159547:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 192 00000100:00100000:0.0:1788744565.159555:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2361:x1875634451126656:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744565.159590:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2361:x1875634451126656:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 36us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744565.159597:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 192 00010000:00010000:1.0:1788744565.876357:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744566.901875:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744567.609880:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744567.609905:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475274240:0@lo:400:kworker.0 00000100:00100000:3.0:1788744567.609923:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744567.609946:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475274624:0@lo:400:kworker.0 00000100:00100000:3.0:1788744567.610012:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744567.610012:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744567.615350:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475274240 00000100:00100000:0.0:1788744567.615375:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475274240 00000100:00100000:1.0:1788744567.615520:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475274368:0@lo:400:kworker.0 00000100:00100000:0.0:1788744567.616568:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788744567.616581:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475274240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744567.620756:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475274624 00000100:00100000:3.0:1788744567.620772:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475274624 00000100:00100000:3.0:1788744567.620849:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788744567.620860:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475274624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744567.620960:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475274624:12345-0@lo:400:kworker.0 Request processed in 104us (10958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744567.620967:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788744567.620986:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788744567.621017:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a241d75c00 x1875634475274624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744567.621031:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475274624:0@lo:400:kworker.0 00000100:00100000:3.0:1788744567.621078:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475274752:0@lo:400:kworker.0 00000100:00100000:3.0:1788744567.621107:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744567.621125:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475274752 00000100:00100000:3.0:1788744567.621143:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475274752 00000100:00100000:3.0:1788744567.621164:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788744567.621169:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475274752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744567.621190:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475274752:12345-0@lo:400:kworker.0 Request processed in 22us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744567.621194:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788744567.621203:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744567.621219:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475274752:0@lo:400:kworker.0 00000100:00100000:1.0:1788744567.629276:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744567.629372:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475274880:0@lo:400:kworker.0 00000100:00100000:1.0:1788744567.629436:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744567.629475:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744567.629483:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475274496:0@lo:400:kworker.0 00000100:00100000:1.0:1788744567.629508:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744567.629556:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475274880 00000100:00100000:1.0:1788744567.629564:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475274880 00000100:00100000:1.0:1788744567.629646:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788744567.629658:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475274880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744567.629724:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475274880:12345-0@lo:400:kworker.0 Request processed in 67us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744567.629732:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788744567.629850:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475274368 00000100:00100000:2.0:1788744567.629857:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475274368 00000100:00100000:2.0:1788744567.629888:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475274496 00000100:00100000:2.0:1788744567.629891:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475274496 00000100:00100000:2.0:1788744567.629911:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788744567.629918:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475274368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744567.629957:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475274368:12345-0@lo:400:kworker.0 Request processed in 40us (6061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744567.629966:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788744567.629998:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788744567.630005:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475274496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744567.630032:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475274496:12345-0@lo:400:kworker.0 Request processed in 28us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744567.630038:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788744567.630464:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744567.630470:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744567.630510:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475274496:0@lo:400:kworker.0 00010000:00080000:1.0:1788744567.630527:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a241d75c00 x1875634475274880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744567.630553:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475274880:0@lo:400:kworker.0 00000100:00100000:1.0:1788744567.630567:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475274368:0@lo:400:kworker.0 00000100:00100000:0.0:1788744567.637627:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475274240:12345-0@lo:400:kworker.0 Request processed in 21040us (27615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744567.637654:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788744567.638270:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475274240:0@lo:400:kworker.0 00010000:00010000:0.0:1788744567.928388:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744568.119679:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744568.119705:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475275008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744568.119788:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744568.121110:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475275008 00000100:00100000:2.0:1788744568.121121:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475275008 00000100:00100000:2.0:1788744568.121210:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788744568.121221:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475275008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744568.121258:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744568.121317:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475275008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744568.121334:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788744568.121376:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23b4c3800 x1875634475275008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744568.121392:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475275008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744568.642845:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744568.642869:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475275136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744568.643083:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744568.643178:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475275136 00000100:00100000:3.0:1788744568.643189:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475275136 00000100:00100000:3.0:1788744568.646684:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788744568.646713:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475275136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744568.646773:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744568.649644:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475275136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2934us (6551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744568.649658:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788744568.649747:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a241d75180 x1875634475275136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744568.649773:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475275136:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788744568.948399:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744569.972593:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744570.279922:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744570.279962:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744570.280002:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744570.280107:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744570.280162:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451127296 00000100:00100000:0.0:1788744570.280164:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451127168 00000100:00100000:2.0:1788744570.280172:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451127296 00000100:00100000:0.0:1788744570.280172:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451127168 00000100:00100000:2.0:1788744570.280218:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:0.0:1788744570.280218:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 194 00000100:00100000:2.0:1788744570.280228:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451127296:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744570.280228:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2359:x1875634451127168:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744570.280305:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451127424 00000100:00100000:1.0:1788744570.280310:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451127424 00000100:00100000:1.0:1788744570.280352:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451127552 00000100:00100000:1.0:1788744570.280355:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451127552 00000100:00100000:1.0:1788744570.280371:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1788744570.280378:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2359:x1875634451127424:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744570.280501:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451127296:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 275us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744570.280509:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:2.0:1788744570.280543:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788744570.280550:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1788744570.280563:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744570.280567:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744570.280569:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744570.283920:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2359:x1875634451127168:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 3683us (3996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744570.283935:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 194 00000100:00100000:1.0:1788744570.284169:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2359:x1875634451127424:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 3788us (4202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744570.284179:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1788744570.284203:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:1.0:1788744570.284214:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2359:x1875634451127552:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744570.284255:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2359:x1875634451127552:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 44us (4148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744570.284399:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000001:02000400:0.0:1788744570.439112:0:9047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing yml_node 00010000:00010000:3.0:1788744570.997363:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744572.020443:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744572.725455:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634475275520:0@lo:400:kworker.0 00000100:00100000:1.0:1788744572.725526:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744572.725603:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788744572.725610:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634475275392:0@lo:400:kworker.0 00000100:00100000:1.0:1788744572.725654:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744572.725684:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475275904:0@lo:400:kworker.0 00000100:00100000:1.0:1788744572.725717:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744572.725761:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475275520 00000100:00100000:1.0:1788744572.725768:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475275520 00000100:00100000:1.0:1788744572.725819:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475275392 00000100:00100000:1.0:1788744572.725823:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475275392 00000100:00100000:1.0:1788744572.725840:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788744572.725848:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634475275520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744572.725900:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634475275520:12345-0@lo:400:kworker.0 Request processed in 52us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744572.725907:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788744572.725925:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788744572.725945:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634475275392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744572.725973:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634475275392:12345-0@lo:400:kworker.0 Request processed in 43us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744572.725979:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788744572.726152:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475275264:0@lo:400:kworker.0 00000100:00100000:3.0:1788744572.726183:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744572.726203:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475275776:0@lo:400:kworker.0 00000100:00100000:3.0:1788744572.726220:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744572.726284:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475275648:0@lo:400:kworker.0 00000100:00100000:2.0:1788744572.726309:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744572.727096:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475275776 00000100:00100000:3.0:1788744572.727102:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475275776 00000100:00100000:3.0:1788744572.727163:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788744572.727170:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475275776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744572.727210:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475275776:12345-0@lo:400:kworker.0 Request processed in 41us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744572.727216:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788744572.727260:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475275776:0@lo:400:kworker.0 00000100:00100000:3.0:1788744572.727294:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634475275392:0@lo:400:kworker.0 00000100:00100000:3.0:1788744572.727303:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634475275520:0@lo:400:kworker.0 00000100:00080000:1.0:1788744572.745631:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744572.745716:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475275264 00000100:00100000:1.0:1788744572.745727:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475275264 00000100:00100000:1.0:1788744572.745796:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788744572.745805:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475275264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744572.745905:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475275264:12345-0@lo:400:kworker.0 Request processed in 101us (19719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744572.745912:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788744572.747217:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475275264:0@lo:400:kworker.0 00000100:00100000:0.0:1788744572.748890:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475275904 00000100:00100000:0.0:1788744572.748901:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475275904 00000100:00100000:0.0:1788744572.748972:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475275648 00000100:00100000:0.0:1788744572.748975:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475275648 00000100:00100000:0.0:1788744572.749007:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788744572.749017:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475275904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744572.749094:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475275904:12345-0@lo:400:kworker.0 Request processed in 79us (23375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744572.749101:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788744572.749116:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788744572.749122:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475275648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744572.749174:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475275648:12345-0@lo:400:kworker.0 Request processed in 52us (22863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744572.749180:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788744572.749377:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23d635180 x1875634475275904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744572.749390:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475275904:0@lo:400:kworker.0 00010000:00080000:2.0:1788744572.751520:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c079f80 x1875634475275648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744572.751536:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475275648:0@lo:400:kworker.0 00000100:00080000:2.0:1788744572.751583:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744572.751588:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788744573.044410:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744573.236507:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744573.236532:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475276032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744573.236603:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744573.236788:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475276032 00000100:00100000:2.0:1788744573.236798:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475276032 00000100:00100000:2.0:1788744573.236854:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788744573.236863:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475276032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744573.236900:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744573.237024:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475276032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744573.237031:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788744573.237104:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23b4c0380 x1875634475276032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744573.237126:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475276032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744573.750292:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475276160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744573.750370:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744573.750668:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475276160 00000100:00100000:3.0:1788744573.750676:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475276160 00000100:00100000:3.0:1788744573.750772:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788744573.750783:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475276160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744573.750817:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744573.750866:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475276160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744573.750873:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788744573.750932:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a241d74e00 x1875634475276160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744573.750949:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475276160:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788744574.070545:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744575.093251:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744575.407689:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744575.407742:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744575.407878:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451127680 00000100:00100000:0.0:1788744575.407895:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451127680 00000100:00100000:0.0:1788744575.407944:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 196 00000100:00100000:0.0:1788744575.407952:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2362:x1875634451127680:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744575.408019:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2362:x1875634451127680:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 68us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744575.408026:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 196 00000100:00100000:2.0:1788744575.409120:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451127808 00000100:00100000:2.0:1788744575.409165:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451127808 00000100:00100000:2.0:1788744575.409214:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:2.0:1788744575.409222:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451127808:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744575.409257:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451127808:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 37us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744575.409264:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00080000:1.0:1788744575.409370:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744575.411211:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744575.411243:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744575.411321:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451127936 00000100:00100000:1.0:1788744575.411341:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451127936 00000100:00100000:1.0:1788744575.411396:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451128064 00000100:00100000:1.0:1788744575.411399:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451128064 00000100:00100000:1.0:1788744575.411424:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:1.0:1788744575.411433:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2358:x1875634451127936:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:1.0:1788744575.411463:0:9032:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391f0f 00000100:00080000:1.0:1788744575.411472:0:9032:0:(import.c:65:import_set_state_nolock()) ffff93a23c09e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744575.411522:0:9032:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1788744575.411582:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744575.411602:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788744575.411610:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2358:x1875634451128064:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:0.0:1788744575.411628:0:6684:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391f16 00000100:00080000:0.0:1788744575.411634:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93a23c7bb800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788744575.411698:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788744575.411840:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+2:2358:x1875634451127936:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 407us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744575.411847:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:0.0:1788744575.411882:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+2:2358:x1875634451128064:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 272us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744575.411888:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00010000:00010000:3.0:1788744575.412352:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788744575.412879:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744575.412883:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788744576.123990:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788744577.083721:0:9239:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.40 00010000:00010000:3.0:1788744577.141578:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744577.846771:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475276288:0@lo:400:kworker.0 00000100:00100000:2.0:1788744577.848069:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744577.848125:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475276800:0@lo:400:kworker.0 00000100:00100000:2.0:1788744577.848173:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744577.848198:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744577.848205:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475276672:0@lo:400:kworker.0 00000100:00100000:2.0:1788744577.848227:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744577.848256:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475276416:0@lo:400:kworker.0 00000100:00100000:2.0:1788744577.849112:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744577.849161:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475276928:0@lo:400:kworker.0 00000100:00100000:2.0:1788744577.849187:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744577.849208:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744577.849215:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475276544:0@lo:400:kworker.0 00000100:00100000:2.0:1788744577.849236:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744577.849382:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475276800 00000100:00100000:2.0:1788744577.849390:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475276800 00000100:00100000:2.0:1788744577.849437:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475276416 00000100:00100000:2.0:1788744577.849440:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475276416 00000100:00100000:2.0:1788744577.849453:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475276544 00000100:00100000:2.0:1788744577.849455:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475276544 00000100:00100000:2.0:1788744577.849472:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788744577.849479:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475276800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744577.849534:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475276800:12345-0@lo:400:kworker.0 Request processed in 54us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744577.849541:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788744577.849561:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788744577.849567:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475276416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744577.849618:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475276416:12345-0@lo:400:kworker.0 Request processed in 51us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744577.849624:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788744577.849637:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788744577.849643:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475276544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744577.849669:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475276544:12345-0@lo:400:kworker.0 Request processed in 27us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744577.849675:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788744577.849691:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744577.849726:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475276800:0@lo:400:kworker.0 00000100:00100000:2.0:1788744577.849751:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475276544:0@lo:400:kworker.0 00000100:00100000:2.0:1788744577.849759:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475276416:0@lo:400:kworker.0 00000100:00100000:0.0:1788744577.850318:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475276288 00000100:00100000:0.0:1788744577.850325:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475276288 00000100:00100000:0.0:1788744577.850358:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788744577.850364:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475276288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744577.850406:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475276288:12345-0@lo:400:kworker.0 Request processed in 42us (2340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744577.850412:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788744577.850450:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475276288:0@lo:400:kworker.0 00000100:00100000:1.0:1788744577.852022:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475276672 00000100:00100000:1.0:1788744577.852032:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475276672 00000100:00100000:1.0:1788744577.852083:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475276928 00000100:00100000:1.0:1788744577.852087:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475276928 00000100:00100000:1.0:1788744577.852110:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744577.852120:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475276672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744577.852199:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475276672:12345-0@lo:400:kworker.0 Request processed in 81us (3970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744577.852205:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744577.852220:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744577.852226:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475276928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744577.852258:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475276928:12345-0@lo:400:kworker.0 Request processed in 32us (3070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744577.852264:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788744577.852402:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744577.852406:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788744577.852450:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd3ea00 x1875634475276928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744577.852464:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475276928:0@lo:400:kworker.0 00010000:00080000:1.0:1788744577.852494:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd3f100 x1875634475276672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744577.852503:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475276672:0@lo:400:kworker.0 00010000:00010000:0.0:1788744578.165334:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744578.356342:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475277056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744578.356405:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744578.356777:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475277056 00000100:00100000:0.0:1788744578.356786:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475277056 00000100:00100000:0.0:1788744578.356893:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788744578.356904:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475277056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744578.356940:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744578.356988:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475277056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744578.356994:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788744578.357077:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23ccba680 x1875634475277056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744578.357095:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475277056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744578.872350:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744578.872374:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475277184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744578.872443:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744578.872724:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475277184 00000100:00100000:0.0:1788744578.872747:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475277184 00000100:00100000:0.0:1788744578.872800:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788744578.872809:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475277184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744578.872843:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744578.872898:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475277184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744578.872905:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788744578.873024:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a241d76300 x1875634475277184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744578.873044:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475277184:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788744579.191873:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788744579.979373:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 390441fa-c0e0-4bda-b106-b1a75da212d8 00000020:00000080:0.0:1788744579.979383:0:7638:0:(genops.c:885:class_export_put()) final put ffff93a23c7be000/390441fa-c0e0-4bda-b106-b1a75da212d8 00000020:00000080:0.0:1788744579.979415:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23c7be000/390441fa-c0e0-4bda-b106-b1a75da212d8 for lustre-OST0001 00000020:00000080:0.0:1788744579.979568:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a23c7bb800 for lustre-OST0001 00010000:00010000:1.0:1788744580.213203:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788744580.477432:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 390441fa-c0e0-4bda-b106-b1a75da212d8 00000020:00000080:2.0:1788744580.477442:0:6709:0:(genops.c:885:class_export_put()) final put ffff93a23c09f000/390441fa-c0e0-4bda-b106-b1a75da212d8 00000020:00000080:3.0:1788744580.477691:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23c09f000/390441fa-c0e0-4bda-b106-b1a75da212d8 for lustre-OST0000 00000020:00000080:3.0:1788744580.477743:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a23c09e000 for lustre-OST0000 00000100:00100000:2.0:1788744580.528189:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744580.528246:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744580.528318:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451128192 00000100:00100000:1.0:1788744580.528328:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451128192 00000100:00100000:1.0:1788744580.528387:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 198 00000100:00100000:1.0:1788744580.528398:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2359:x1875634451128192:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744580.528466:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2359:x1875634451128192:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 70us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744580.528485:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 198 00000100:00100000:3.0:1788744580.528706:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451128320 00000100:00100000:3.0:1788744580.528712:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451128320 00000100:00100000:3.0:1788744580.528764:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:3.0:1788744580.528772:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2360:x1875634451128320:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744580.528815:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2360:x1875634451128320:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 45us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744580.528822:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00080000:1.0:1788744580.529391:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788744580.907767:0:9339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.40 00010000:00010000:0.0:1788744581.244786:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744582.263896:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744582.966557:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634475277568:0@lo:400:kworker.0 00000100:00100000:3.0:1788744582.966631:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744582.966696:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788744582.966704:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634475277440:0@lo:400:kworker.0 00000100:00100000:3.0:1788744582.966727:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744582.966746:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475277952:0@lo:400:kworker.0 00000100:00100000:3.0:1788744582.966771:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744582.966811:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475277568 00000100:00100000:3.0:1788744582.966818:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475277568 00000100:00100000:3.0:1788744582.966867:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475277440 00000100:00100000:3.0:1788744582.966871:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475277440 00000100:00100000:3.0:1788744582.966889:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788744582.966898:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634475277568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744582.966948:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634475277568:12345-0@lo:400:kworker.0 Request processed in 51us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744582.966955:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788744582.966972:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788744582.967008:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634475277440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744582.967036:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634475277440:12345-0@lo:400:kworker.0 Request processed in 31us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744582.967042:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788744582.967061:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475277952 00000100:00100000:3.0:1788744582.967065:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475277952 00000100:00100000:3.0:1788744582.967094:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744582.967100:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475277952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744582.967175:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475277952:12345-0@lo:400:kworker.0 Request processed in 29us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744582.967191:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788744582.967208:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744582.967213:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744582.967250:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634475277440:0@lo:400:kworker.0 00010000:00080000:3.0:1788744582.967264:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a241d76a00 x1875634475277952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744582.967274:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475277952:0@lo:400:kworker.0 00000100:00100000:3.0:1788744582.967283:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634475277568:0@lo:400:kworker.0 00000100:00100000:0.0:1788744582.967674:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475277696:0@lo:400:kworker.0 00000100:00100000:0.0:1788744582.967710:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744582.967745:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788744582.967752:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475277312:0@lo:400:kworker.0 00000100:00100000:0.0:1788744582.967779:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744582.967809:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475277824:0@lo:400:kworker.0 00000100:00100000:0.0:1788744582.967831:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744582.967856:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475277824 00000100:00100000:0.0:1788744582.967860:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475277824 00000100:00100000:0.0:1788744582.967891:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788744582.967899:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475277824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744582.967933:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475277824:12345-0@lo:400:kworker.0 Request processed in 35us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744582.967938:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788744582.967965:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744582.967984:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475277824:0@lo:400:kworker.0 00000100:00100000:1.0:1788744582.968065:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475277696 00000100:00100000:1.0:1788744582.968075:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475277696 00000100:00100000:1.0:1788744582.968117:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744582.968124:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475277696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744582.968211:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475277696:12345-0@lo:400:kworker.0 Request processed in 88us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744582.968218:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788744582.968250:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a241d76300 x1875634475277696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744582.968259:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475277696:0@lo:400:kworker.0 00000100:00080000:0.0:1788744582.968717:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744582.969585:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475277312 00000100:00100000:3.0:1788744582.969595:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475277312 00000100:00100000:3.0:1788744582.969661:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788744582.969670:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475277312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744582.971155:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475277312:12345-0@lo:400:kworker.0 Request processed in 1431us (3320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744582.971176:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788744582.978710:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475277312:0@lo:400:kworker.0 00010000:00010000:3.0:1788744583.286357:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744583.476590:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744583.476620:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475278080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744583.476680:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744583.478468:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475278080 00000100:00100000:0.0:1788744583.478479:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475278080 00000100:00100000:0.0:1788744583.478528:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788744583.478536:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475278080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744583.478565:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744583.478645:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475278080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (1963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744583.478651:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788744583.478687:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a204ffa300 x1875634475278080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744583.478703:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ffa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475278080:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788744583.868047:0:9436:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.40 00000100:00100000:2.0:1788744583.994986:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744583.995007:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475278208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744583.995075:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744583.995183:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475278208 00000100:00100000:2.0:1788744583.995199:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475278208 00000100:00100000:2.0:1788744583.995266:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788744583.995275:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475278208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744583.995480:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744583.995536:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475278208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 262us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744583.995544:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788744583.995590:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd3ed80 x1875634475278208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744583.995609:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475278208:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788744584.308502:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744585.336570:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744585.639321:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744585.639358:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744585.639809:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451128576 00000100:00100000:0.0:1788744585.639819:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451128576 00000100:00100000:0.0:1788744585.639887:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:0.0:1788744585.639897:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451128576:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744585.639977:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451128576:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 81us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744585.639984:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00080000:3.0:1788744585.640260:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744585.640543:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451128448 00000100:00100000:2.0:1788744585.640549:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451128448 00000100:00100000:2.0:1788744585.640591:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 200 00000100:00100000:2.0:1788744585.640600:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2362:x1875634451128448:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744585.640756:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2362:x1875634451128448:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 157us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744585.640764:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 200 00000001:02000400:2.0:1788744586.341616:0:9485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sun Sep 6 21:29:43 EDT 2026 00010000:00010000:3.0:1788744586.360742:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744587.381500:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744588.086183:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475278720:0@lo:400:kworker.0 00000100:00100000:0.0:1788744588.086270:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744588.086345:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788744588.086352:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475278336:0@lo:400:kworker.0 00000100:00100000:0.0:1788744588.086382:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744588.086409:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475278848:0@lo:400:kworker.0 00000100:00100000:0.0:1788744588.086433:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744588.086462:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475278464:0@lo:400:kworker.0 00000100:00100000:0.0:1788744588.086485:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744588.086518:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475278976:0@lo:400:kworker.0 00000100:00100000:0.0:1788744588.086559:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744588.086578:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744588.086584:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475278592:0@lo:400:kworker.0 00000100:00100000:0.0:1788744588.086604:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744588.086636:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475278720 00000100:00100000:0.0:1788744588.086644:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475278720 00000100:00100000:0.0:1788744588.086697:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475278976 00000100:00100000:0.0:1788744588.086699:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475278976 00000100:00100000:0.0:1788744588.086725:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788744588.086733:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475278720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744588.086788:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475278720:12345-0@lo:400:kworker.0 Request processed in 55us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744588.086794:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788744588.086812:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788744588.086818:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475278976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744588.086849:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475278976:12345-0@lo:400:kworker.0 Request processed in 31us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744588.086855:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788744588.086881:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475278336 00000100:00100000:0.0:1788744588.086886:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475278336 00000100:00100000:0.0:1788744588.086911:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788744588.086918:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475278336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744588.086949:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475278336:12345-0@lo:400:kworker.0 Request processed in 32us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744588.086955:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788744588.086982:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475278848 00000100:00100000:0.0:1788744588.086986:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475278848 00000100:00100000:0.0:1788744588.087005:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475278464 00000100:00100000:0.0:1788744588.087007:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475278464 00000100:00100000:0.0:1788744588.087018:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475278592 00000100:00100000:0.0:1788744588.087020:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475278592 00000100:00100000:0.0:1788744588.087035:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788744588.087041:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475278848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744588.087071:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475278848:12345-0@lo:400:kworker.0 Request processed in 30us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744588.087076:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788744588.087088:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788744588.087106:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475278464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744588.087154:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475278464:12345-0@lo:400:kworker.0 Request processed in 61us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744588.087160:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788744588.087172:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788744588.087178:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475278592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744588.087203:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475278592:12345-0@lo:400:kworker.0 Request processed in 25us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744588.087218:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788744588.087244:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744588.087249:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744588.087251:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744588.087285:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475278592:0@lo:400:kworker.0 00000100:00100000:0.0:1788744588.087296:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475278464:0@lo:400:kworker.0 00010000:00080000:0.0:1788744588.087307:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a106fb4000 x1875634475278976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744588.087318:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475278976:0@lo:400:kworker.0 00000100:00100000:0.0:1788744588.087348:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475278336:0@lo:400:kworker.0 00000100:00100000:0.0:1788744588.087357:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475278848:0@lo:400:kworker.0 00010000:00080000:0.0:1788744588.087366:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a106fb4700 x1875634475278720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744588.087373:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475278720:0@lo:400:kworker.0 00010000:00010000:1.0:1788744588.404406:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744588.606905:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475279104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744588.606977:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744588.607089:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475279104 00000100:00100000:2.0:1788744588.607099:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475279104 00000100:00100000:2.0:1788744588.607171:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788744588.607181:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475279104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744588.607217:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744588.622069:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475279104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14878us (15080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744588.622106:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788744588.622259:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a204ff9c00 x1875634475279104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744588.622284:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475279104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744589.108482:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744589.108504:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475279232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744589.108583:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744589.109612:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475279232 00000100:00100000:3.0:1788744589.109623:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475279232 00000100:00100000:3.0:1788744589.109958:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744589.109990:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475279232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744589.110025:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744589.110092:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475279232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744589.110100:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788744589.110176:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a241d77b80 x1875634475279232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744589.110195:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475279232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788744589.430434:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744590.457362:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744590.770974:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744590.771092:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744590.771152:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451128832 00000100:00100000:0.0:1788744590.771161:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451128832 00000100:00100000:0.0:1788744590.771216:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:0.0:1788744590.771226:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451128832:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744590.771308:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451128832:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744590.771324:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00080000:0.0:1788744590.771344:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744590.773996:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451128704 00000100:00100000:3.0:1788744590.774013:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451128704 00000100:00100000:3.0:1788744590.774083:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 202 00000100:00100000:3.0:1788744590.774094:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2362:x1875634451128704:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744590.774182:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2362:x1875634451128704:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 90us (3217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744590.774190:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 202 00010000:00010000:3.0:1788744591.479285:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744592.504125:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744593.208450:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475279360:0@lo:400:kworker.0 00000100:00100000:3.0:1788744593.208530:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744593.210299:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475279488:0@lo:400:kworker.0 00000100:00100000:2.0:1788744593.210357:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744593.210423:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744593.210429:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475279616:0@lo:400:kworker.0 00000100:00100000:2.0:1788744593.210484:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744593.210539:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475280000:0@lo:400:kworker.0 00000100:00100000:2.0:1788744593.210566:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744593.210995:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475279744:0@lo:400:kworker.0 00000100:00100000:0.0:1788744593.211040:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744593.211081:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744593.211087:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475279872:0@lo:400:kworker.0 00000100:00100000:0.0:1788744593.211108:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744593.211159:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475279360 00000100:00100000:0.0:1788744593.211168:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475279360 00000100:00100000:0.0:1788744593.211225:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788744593.211234:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475279360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744593.211389:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475279360:12345-0@lo:400:kworker.0 Request processed in 155us (2858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744593.211396:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788744593.211432:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475279488 00000100:00100000:0.0:1788744593.211436:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475279488 00000100:00100000:0.0:1788744593.211454:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475279616 00000100:00100000:0.0:1788744593.211456:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475279616 00000100:00100000:0.0:1788744593.211476:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475279872 00000100:00100000:0.0:1788744593.211478:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475279872 00000100:00100000:0.0:1788744593.211490:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788744593.211497:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475279488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744593.211534:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475279488:12345-0@lo:400:kworker.0 Request processed in 38us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744593.211540:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788744593.211605:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788744593.211626:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475279616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744593.211655:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475279616:12345-0@lo:400:kworker.0 Request processed in 30us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744593.211661:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788744593.211674:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788744593.211680:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475279872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744593.211711:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475279872:12345-0@lo:400:kworker.0 Request processed in 31us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744593.211717:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788744593.211736:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475280000 00000100:00100000:0.0:1788744593.211739:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475280000 00000100:00100000:0.0:1788744593.211761:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475279744 00000100:00100000:0.0:1788744593.211764:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475279744 00000100:00100000:0.0:1788744593.211783:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744593.211789:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475280000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744593.211819:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475280000:12345-0@lo:400:kworker.0 Request processed in 30us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744593.211825:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744593.211836:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788744593.211843:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475279744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744593.211868:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475279744:12345-0@lo:400:kworker.0 Request processed in 26us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744593.211874:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788744593.211894:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744593.211897:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744593.211900:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744593.211933:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475279872:0@lo:400:kworker.0 00010000:00080000:0.0:1788744593.211954:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd3d180 x1875634475279744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744593.211965:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475279744:0@lo:400:kworker.0 00010000:00080000:0.0:1788744593.212013:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd3c000 x1875634475280000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744593.212022:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475280000:0@lo:400:kworker.0 00000100:00100000:0.0:1788744593.212034:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475279616:0@lo:400:kworker.0 00000100:00100000:0.0:1788744593.212042:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475279488:0@lo:400:kworker.0 00000100:00100000:2.0:1788744593.214311:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475279360:0@lo:400:kworker.0 00010000:00010000:1.0:1788744593.524581:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744593.729433:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475280128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744593.729499:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744593.731253:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475280128 00000100:00100000:2.0:1788744593.731265:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475280128 00000100:00100000:2.0:1788744593.731346:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788744593.731357:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475280128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744593.731402:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744593.734285:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475280128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2921us (4775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744593.734299:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788744593.734964:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a204ffb800 x1875634475280128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744593.734987:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475280128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744594.243206:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475280256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744594.243287:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744594.243446:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475280256 00000100:00100000:0.0:1788744594.243454:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475280256 00000100:00100000:0.0:1788744594.243523:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788744594.243534:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475280256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744594.243576:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744594.243857:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475280256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 324us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744594.243865:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788744594.243912:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd2fb80 x1875634475280256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744610 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744594.243933:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475280256:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788744594.552512:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744595.574274:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744595.880056:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744595.880207:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744595.880274:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451129088 00000100:00100000:1.0:1788744595.880285:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451129088 00000100:00100000:1.0:1788744595.880364:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:1.0:1788744595.880374:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2361:x1875634451129088:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744595.880444:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2361:x1875634451129088:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 72us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744595.880451:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00080000:2.0:1788744595.880668:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744595.880726:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451128960 00000100:00100000:0.0:1788744595.880731:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451128960 00000100:00100000:0.0:1788744595.880803:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 204 00000100:00100000:0.0:1788744595.880811:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2362:x1875634451128960:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744595.880838:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2362:x1875634451128960:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 29us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744595.880845:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 204 00010000:00010000:1.0:1788744596.596661:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744597.620304:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744598.328271:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475280384:0@lo:400:kworker.0 00000100:00100000:0.0:1788744598.329697:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475280768:0@lo:400:kworker.0 00000100:00100000:1.0:1788744598.330501:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744598.330637:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475280896:0@lo:400:kworker.0 00000100:00100000:1.0:1788744598.330669:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744598.330713:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475280512:0@lo:400:kworker.0 00000100:00100000:1.0:1788744598.330738:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744598.330758:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475281024:0@lo:400:kworker.0 00000100:00100000:1.0:1788744598.330780:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744598.330800:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744598.330807:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475280640:0@lo:400:kworker.0 00000100:00100000:1.0:1788744598.330841:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744598.330871:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475280896 00000100:00100000:1.0:1788744598.330878:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475280896 00000100:00100000:1.0:1788744598.331108:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475280512 00000100:00100000:1.0:1788744598.331112:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475280512 00000100:00100000:1.0:1788744598.331127:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475280640 00000100:00100000:1.0:1788744598.331147:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475280640 00000100:00100000:1.0:1788744598.331166:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788744598.331174:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475280896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744598.331230:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475280896:12345-0@lo:400:kworker.0 Request processed in 56us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744598.331237:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788744598.331253:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788744598.331264:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475280512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744598.331384:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475280512:12345-0@lo:400:kworker.0 Request processed in 125us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744598.331391:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788744598.331404:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788744598.331410:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475280640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744598.331447:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475280640:12345-0@lo:400:kworker.0 Request processed in 37us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744598.331453:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788744598.331477:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475281024 00000100:00100000:1.0:1788744598.331482:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475281024 00000100:00100000:1.0:1788744598.331510:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788744598.331515:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475281024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744598.331544:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ffa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475281024:12345-0@lo:400:kworker.0 Request processed in 29us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744598.331550:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788744598.331568:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744598.331573:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744598.332765:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475280640:0@lo:400:kworker.0 00000100:00100000:1.0:1788744598.332788:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475280512:0@lo:400:kworker.0 00010000:00080000:1.0:1788744598.332801:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a204ff9f80 x1875634475281024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744598.332811:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475281024:0@lo:400:kworker.0 00000100:00100000:1.0:1788744598.332923:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475280896:0@lo:400:kworker.0 00000100:00100000:0.0:1788744598.332956:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744598.333410:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475280384 00000100:00100000:2.0:1788744598.333417:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475280384 00000100:00100000:2.0:1788744598.333453:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788744598.333462:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475280384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744598.333518:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475280384:12345-0@lo:400:kworker.0 Request processed in 57us (3019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744598.333524:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788744598.333942:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475280768 00000100:00100000:1.0:1788744598.333947:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475280768 00000100:00100000:1.0:1788744598.333996:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788744598.334002:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475280768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744598.334043:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475280768:12345-0@lo:400:kworker.0 Request processed in 41us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744598.334048:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788744598.334088:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ff8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475280384:0@lo:400:kworker.0 00000100:00080000:2.0:1788744598.334106:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788744598.334114:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a204ff8000 x1875634475280768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744598.334308:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475280768:0@lo:400:kworker.0 00010000:00010000:2.0:1788744598.644598:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744598.846531:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744598.846556:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475281152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744598.846637:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744598.846708:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475281152 00000100:00100000:1.0:1788744598.846718:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475281152 00000100:00100000:1.0:1788744598.846785:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788744598.846796:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475281152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744598.846852:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744598.846902:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475281152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744598.846919:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788744598.846962:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a204ff8000 x1875634475281152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744598.846981:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475281152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744599.348442:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744599.350520:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475281280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744599.350600:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744599.351237:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475281280 00000100:00100000:1.0:1788744599.351247:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475281280 00000100:00100000:1.0:1788744599.351351:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788744599.351361:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475281280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744599.351399:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744599.351471:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475281280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744599.351494:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788744599.351564:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd2d880 x1875634475281280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744599.351583:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475281280:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788744599.669232:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744600.692282:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744600.999287:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744600.999331:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744600.999394:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451129344 00000100:00100000:3.0:1788744600.999405:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451129344 00000100:00100000:3.0:1788744600.999492:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:3.0:1788744600.999505:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451129344:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744600.999595:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451129344:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 94us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744600.999604:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00080000:2.0:1788744601.000062:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744601.000108:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451129216 00000100:00100000:0.0:1788744601.000115:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451129216 00000100:00100000:0.0:1788744601.000198:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 206 00000100:00100000:0.0:1788744601.000208:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2362:x1875634451129216:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744601.000249:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2362:x1875634451129216:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 44us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744601.000255:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 206 00010000:00010000:1.0:1788744601.717162:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744602.743300:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788744603.414636:0:10115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:30:01 (1788744601) === 00000100:00100000:1.0:1788744603.444385:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634475281664:0@lo:400:kworker.0 00000100:00100000:1.0:1788744603.444457:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744603.444520:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788744603.444527:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634475281536:0@lo:400:kworker.0 00000100:00100000:1.0:1788744603.444549:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744603.444569:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475282048:0@lo:400:kworker.0 00000100:00100000:1.0:1788744603.444626:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744603.444675:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475281664 00000100:00100000:1.0:1788744603.444683:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475281664 00000100:00100000:1.0:1788744603.444731:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475281536 00000100:00100000:1.0:1788744603.444734:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475281536 00000100:00100000:1.0:1788744603.444753:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788744603.444761:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634475281664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744603.444814:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634475281664:12345-0@lo:400:kworker.0 Request processed in 53us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744603.444821:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788744603.444851:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788744603.444858:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634475281536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744603.444884:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634475281536:12345-0@lo:400:kworker.0 Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744603.444890:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788744603.444909:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744603.444940:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634475281536:0@lo:400:kworker.0 00000100:00100000:1.0:1788744603.444964:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634475281664:0@lo:400:kworker.0 00000100:00100000:0.0:1788744603.445026:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475281792:0@lo:400:kworker.0 00000100:00100000:0.0:1788744603.445057:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744603.445088:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788744603.445095:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475281408:0@lo:400:kworker.0 00000100:00100000:0.0:1788744603.445120:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744603.445361:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475281920:0@lo:400:kworker.0 00000100:00100000:0.0:1788744603.445381:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744603.445405:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475281408 00000100:00100000:0.0:1788744603.445409:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475281408 00000100:00100000:0.0:1788744603.445440:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788744603.445446:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475281408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744603.445478:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475281408:12345-0@lo:400:kworker.0 Request processed in 32us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744603.445485:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788744603.445518:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475281408:0@lo:400:kworker.0 00000100:00100000:0.0:1788744603.445533:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475281920 00000100:00100000:0.0:1788744603.445537:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475281920 00000100:00100000:0.0:1788744603.445566:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788744603.445571:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475281920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744603.445602:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475281920:12345-0@lo:400:kworker.0 Request processed in 31us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744603.445607:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788744603.445622:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744603.445637:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475281920:0@lo:400:kworker.0 00000100:00100000:3.0:1788744603.445955:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475282048 00000100:00100000:3.0:1788744603.445961:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475282048 00000100:00100000:3.0:1788744603.445994:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475281792 00000100:00100000:3.0:1788744603.445997:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475281792 00000100:00100000:3.0:1788744603.446016:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788744603.446023:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475282048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744603.446062:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475282048:12345-0@lo:400:kworker.0 Request processed in 40us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744603.446075:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788744603.446087:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788744603.446093:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475281792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744603.446140:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475281792:12345-0@lo:400:kworker.0 Request processed in 35us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744603.446147:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788744603.446157:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a204ff9180 x1875634475281792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788744603.446165:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744603.446168:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744603.446168:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475281792:0@lo:400:kworker.0 00010000:00080000:3.0:1788744603.446183:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a204ffb800 x1875634475282048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744603.446193:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475282048:0@lo:400:kworker.0 00010000:00010000:2.0:1788744603.764637:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744603.899188:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744603.899513:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451129472 00000100:00100000:3.0:1788744603.899533:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451129472 00000100:00100000:3.0:1788744603.899585:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 208 00000100:00100000:3.0:1788744603.899595:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:8118:x1875634451129472:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788744603.899612:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744603.899631:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e80e00/0x4b162761eb391fda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d54db5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744603.899662:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e80e00/0x4b162761eb391fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54db5 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744603.899674:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e80e00/0x4b162761eb391fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54db5 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744603.899683:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80e00, rc 0) 00000100:00100000:3.0:1788744603.899765:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+11:8118:x1875634451129472:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 171us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744603.899772:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 208 00000100:00100000:2.0:1788744603.909465:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744603.909651:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451129600 00000100:00100000:0.0:1788744603.909662:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451129600 00000100:00100000:0.0:1788744603.909724:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 209 00000100:00100000:0.0:1788744603.909735:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+11:8118:x1875634451129600:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788744603.910502:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+11:8118:x1875634451129600:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 764us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744603.910511:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 209 00000100:00100000:3.0:1788744603.925939:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744603.926064:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451129728 00000100:00100000:0.0:1788744603.926083:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451129728 00000100:00100000:0.0:1788744603.926184:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 210 00000100:00100000:0.0:1788744603.926196:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20791e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+11:8118:x1875634451129728:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788744603.926477:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20791e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+11:8118:x1875634451129728:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 283us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744603.926486:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 210 00000100:00100000:2.0:1788744603.933855:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744603.934049:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451129856 00000100:00100000:0.0:1788744603.934059:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451129856 00000100:00100000:0.0:1788744603.934158:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 211 00000100:00100000:0.0:1788744603.934177:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20791e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+11:8122:x1875634451129856:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744603.934731:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20791e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+11:8122:x1875634451129856:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 554us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744603.934739:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 211 00000100:00100000:3.0:1788744603.956578:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475282176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744603.956662:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744603.958359:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475282176 00000100:00100000:1.0:1788744603.958375:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475282176 00000100:00100000:1.0:1788744603.958445:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788744603.958456:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475282176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744603.958500:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744603.958593:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475282176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744603.958600:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788744603.958715:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c06b100 x1875634475282176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744603.958738:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475282176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744603.968437:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744603.968551:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451129984 00000100:00100000:3.0:1788744603.968562:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451129984 00000100:00100000:3.0:1788744603.968616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 212 00000100:00100000:3.0:1788744603.968626:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20791dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+11:8122:x1875634451129984:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788744603.969052:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20791dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+11:8122:x1875634451129984:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 425us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744603.969060:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 212 00000100:00100000:3.0:1788744603.983230:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744603.983398:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451130112 00000100:00100000:0.0:1788744603.983410:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451130112 00000100:00100000:0.0:1788744603.983461:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 213 00000100:00100000:0.0:1788744603.983471:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20791cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+11:8118:x1875634451130112:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788744603.983490:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744603.983512:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a23d17f000/0x4b162761eb391fe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d54ddf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744603.983543:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23d17f000/0x4b162761eb391fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ddf expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744603.983554:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a23d17f000/0x4b162761eb391fe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ddf expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744603.983580:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17f000, rc 0) 00000100:00100000:0.0:1788744603.983655:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20791cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:8118:x1875634451130112:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 184us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744603.983661:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 213 00000100:00100000:0.0:1788744603.989026:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744603.989232:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451130240 00000100:00100000:3.0:1788744603.989243:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451130240 00000100:00100000:3.0:1788744603.989301:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 214 00000100:00100000:3.0:1788744603.989311:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:8118:x1875634451130240:12345-192.168.201.6@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788744603.989339:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788744603.989372:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788744603.989377:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788744603.989380:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788744603.989383:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788744603.992937:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:8118:x1875634451130240:12345-192.168.201.6@tcp:256:mount.lustre.0 Request processed in 3614us (3922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744603.992952:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 214 00000100:00100000:1.0:1788744604.000759:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744604.003187:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451130368 00000100:00100000:2.0:1788744604.003203:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451130368 00000100:00100000:2.0:1788744604.003316:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 215 00000100:00100000:2.0:1788744604.003329:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:8118:x1875634451130368:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788744604.003363:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744604.003382:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2064f2c00/0x4b162761eb391fe8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d54de6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744604.003412:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2064f2c00/0x4b162761eb391fe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54de6 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744604.003425:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2064f2c00/0x4b162761eb391fe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54de6 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744604.003434:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2c00, rc 0) 00000100:00100000:2.0:1788744604.003502:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:8118:x1875634451130368:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 176us (2755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744604.003509:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 215 00000100:00100000:0.0:1788744604.009422:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744604.009752:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451130496 00000100:00100000:3.0:1788744604.009763:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451130496 00000100:00100000:3.0:1788744604.009828:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 216 00000100:00100000:3.0:1788744604.009838:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:8118:x1875634451130496:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788744604.010190:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:8118:x1875634451130496:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 352us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744604.010198:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 216 00000100:00100000:1.0:1788744604.012485:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744604.012587:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451130624 00000100:00100000:2.0:1788744604.012599:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451130624 00000100:00100000:2.0:1788744604.012652:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 217 00000100:00100000:2.0:1788744604.012661:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:8118:x1875634451130624:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788744604.013050:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:8118:x1875634451130624:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 390us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744604.013059:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 217 00000100:00100000:1.0:1788744604.018524:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744604.018595:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451130752 00000100:00100000:0.0:1788744604.018605:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451130752 00000100:00100000:0.0:1788744604.018827:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 218 00000100:00100000:0.0:1788744604.018841:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:8126:x1875634451130752:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744604.019538:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:8126:x1875634451130752:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 697us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744604.019548:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 218 00000100:00100000:2.0:1788744604.022201:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744604.022362:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451130880 00000100:00100000:3.0:1788744604.022375:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451130880 00000100:00100000:3.0:1788744604.022467:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 219 00000100:00100000:3.0:1788744604.022478:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:8126:x1875634451130880:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788744604.022957:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:8126:x1875634451130880:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 478us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744604.022966:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 219 00000100:00100000:1.0:1788744604.032761:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744604.032826:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744604.032949:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451131392 00000100:00100000:0.0:1788744604.032960:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451131392 00000100:00100000:0.0:1788744604.033113:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451131008 00000100:00100000:0.0:1788744604.033117:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451131008 00000100:00080000:1.0:1788744604.033175:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744604.033478:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:3.0:1788744604.033492:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451131392:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744604.033584:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451131392:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 97us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744604.033593:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:3.0:1788744604.033615:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:3.0:1788744604.033620:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1875634451131008:12345-192.168.201.6@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788744604.033646:0:5841:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 3d79cafb-2132-4187-a776-0e0ed417e77b@192.168.201.6@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:3.0:1788744604.033709:0:5841:0:(genops.c:1384:class_connect()) connect: client 3d79cafb-2132-4187-a776-0e0ed417e77b, cookie 0x4b162761eb391fef 00000004:00100000:3.0:1788744604.033744:0:5841:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788744604.034375:0:5841:0:(import.c:65:import_set_state_nolock()) ffff93a23f86b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744604.034411:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d79cafb-2132-4187-a776-0e0ed417e77b+6:2358:x1875634451131008:12345-192.168.201.6@tcp:38:mount.lustre.0 Request processed in 788us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744604.034418:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:1.0:1788744604.041458:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744604.041545:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744604.041670:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451131136 00000100:00100000:0.0:1788744604.041681:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451131136 00000100:00100000:0.0:1788744604.041759:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451131264 00000100:00100000:0.0:1788744604.041763:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451131264 00000100:00100000:0.0:1788744604.041780:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788744604.041789:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+7:0:x1875634451131136:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788744604.041864:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788744604.041966:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+7:0:x1875634451131136:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 177us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744604.041992:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788744604.042012:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1788744604.042019:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+6:8118:x1875634451131264:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788744604.042031:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788744604.042055:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+6:8118:x1875634451131264:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 37us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744604.042062:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00080000:1.0:1788744604.042707:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744604.047784:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744604.048055:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451131520 00000100:00100000:0.0:1788744604.048076:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451131520 00000100:00100000:0.0:1788744604.048170:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1788744604.048181:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+6:8118:x1875634451131520:12345-192.168.201.6@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788744604.048586:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+6:8118:x1875634451131520:12345-192.168.201.6@tcp:40:mount.lustre.0 Request processed in 406us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744604.048594:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1788744604.061539:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744604.062179:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451131648 00000100:00100000:1.0:1788744604.062284:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744604.062346:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744604.062575:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451131904 00000100:00100000:2.0:1788744604.062585:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451131904 00000100:00100000:2.0:1788744604.062647:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:2.0:1788744604.062658:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+6:8118:x1875634451131904:12345-192.168.201.6@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788744604.062740:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788744604.062845:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+6:8118:x1875634451131904:12345-192.168.201.6@tcp:33:mount.lustre.0 Request processed in 188us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744604.062853:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:3.0:1788744604.063079:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451131648 00000100:00100000:3.0:1788744604.063114:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451131776 00000100:00100000:3.0:1788744604.063117:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451131776 00000100:00100000:3.0:1788744604.063165:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:3.0:1788744604.063172:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1875634451131648:12345-192.168.201.6@tcp:8:mount.lustre.0 00000100:00100000:1.0:1788744604.063273:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:1.0:1788744604.063279:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875634451131776:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788744604.063298:0:6685:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 3d79cafb-2132-4187-a776-0e0ed417e77b@192.168.201.6@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:1.0:1788744604.063330:0:6685:0:(genops.c:1384:class_connect()) connect: client 3d79cafb-2132-4187-a776-0e0ed417e77b, cookie 0x4b162761eb391ff6 00002000:00100000:1.0:1788744604.063354:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3d79cafb-2132-4187-a776-0e0ed417e77b/ffff93a23cd67800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788744604.063375:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788744604.063617:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788744604.063647:0:6685:0:(import.c:65:import_set_state_nolock()) ffff93a23cd65000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744604.063687:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+6:2358:x1875634451131776:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 406us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744604.063694:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00010000:00080000:3.0:1788744604.063811:0:9032:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 3d79cafb-2132-4187-a776-0e0ed417e77b@192.168.201.6@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:3.0:1788744604.063840:0:9032:0:(genops.c:1384:class_connect()) connect: client 3d79cafb-2132-4187-a776-0e0ed417e77b, cookie 0x4b162761eb391ffd 00002000:00100000:3.0:1788744604.063844:0:9032:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3d79cafb-2132-4187-a776-0e0ed417e77b/ffff93a23f86c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788744604.063860:0:9032:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788744604.063984:0:9032:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788744604.064006:0:9032:0:(import.c:65:import_set_state_nolock()) ffff93a23f86d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744604.064028:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3d79cafb-2132-4187-a776-0e0ed417e77b+6:2358:x1875634451131648:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 856us (2501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744604.064034:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:2.0:1788744604.468664:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475282304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744604.468755:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744604.468935:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475282304 00000100:00100000:1.0:1788744604.468944:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475282304 00000100:00100000:1.0:1788744604.469010:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788744604.469020:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475282304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744604.469042:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744604.469840:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475282304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 818us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744604.469850:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788744604.469951:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd2d180 x1875634475282304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744604.469972:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475282304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788744604.789461:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788744605.557240:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d79cafb-2132-4187-a776-0e0ed417e77b 00000001:00100000:3.0:1788744605.585889:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3d79cafb-2132-4187-a776-0e0ed417e77b 00010000:00010000:0.0:1788744605.813357:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788744606.099800:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d79cafb-2132-4187-a776-0e0ed417e77b 00010000:00010000:0.0:1788744606.836430:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744607.862717:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744608.572187:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475282816:0@lo:400:kworker.0 00000100:00100000:0.0:1788744608.572286:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744608.572388:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788744608.572396:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475282432:0@lo:400:kworker.0 00000100:00100000:0.0:1788744608.572429:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744608.572465:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475282944:0@lo:400:kworker.0 00000100:00100000:0.0:1788744608.572493:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744608.572525:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475282432 00000100:00100000:0.0:1788744608.572533:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475282432 00000100:00100000:0.0:1788744608.572593:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788744608.572602:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475282432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744608.572659:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475282432:12345-0@lo:400:kworker.0 Request processed in 59us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744608.572666:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788744608.572724:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475282432:0@lo:400:kworker.0 00000100:00100000:1.0:1788744608.572982:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475282560:0@lo:400:kworker.0 00000100:00100000:1.0:1788744608.573030:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744608.573068:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475283072:0@lo:400:kworker.0 00000100:00100000:1.0:1788744608.573094:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744608.573113:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744608.573120:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475282688:0@lo:400:kworker.0 00000100:00100000:1.0:1788744608.573173:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744608.573464:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475282944 00000100:00100000:0.0:1788744608.573472:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475282944 00000100:00100000:0.0:1788744608.573520:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475282560 00000100:00100000:0.0:1788744608.573524:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475282560 00000100:00100000:0.0:1788744608.573539:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475282688 00000100:00100000:0.0:1788744608.573541:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475282688 00000100:00100000:0.0:1788744608.573560:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788744608.573567:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475282944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744608.573618:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475282944:12345-0@lo:400:kworker.0 Request processed in 52us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744608.573625:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788744608.573642:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788744608.573648:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475282560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744608.573679:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475282560:12345-0@lo:400:kworker.0 Request processed in 32us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744608.573685:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788744608.573697:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788744608.573717:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475282688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744608.573765:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475282688:12345-0@lo:400:kworker.0 Request processed in 49us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744608.573771:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788744608.573827:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475282688:0@lo:400:kworker.0 00000100:00100000:0.0:1788744608.573839:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475282560:0@lo:400:kworker.0 00000100:00100000:0.0:1788744608.573867:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475282944:0@lo:400:kworker.0 00000100:00100000:3.0:1788744608.574184:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475282816 00000100:00100000:3.0:1788744608.574190:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475282816 00000100:00100000:3.0:1788744608.574226:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475283072 00000100:00100000:3.0:1788744608.574229:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475283072 00000100:00100000:3.0:1788744608.574268:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744608.574276:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475282816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744608.574326:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475282816:12345-0@lo:400:kworker.0 Request processed in 50us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744608.574331:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744608.574358:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788744608.574365:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475283072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744608.574400:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475283072:12345-0@lo:400:kworker.0 Request processed in 36us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744608.574405:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788744608.574441:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c06c380 x1875634475283072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744608.574453:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475283072:0@lo:400:kworker.0 00000100:00080000:1.0:1788744608.574593:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744608.574600:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744608.574603:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788744608.574744:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c06ea00 x1875634475282816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744608.574755:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475282816:0@lo:400:kworker.0 00010000:00010000:1.0:1788744608.884862:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744609.077388:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475283200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744609.077768:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744609.078121:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475283200 00000100:00100000:2.0:1788744609.078274:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475283200 00000100:00100000:3.0:1788744609.078444:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788744609.078454:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475283200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744609.078491:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744609.078595:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475283200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744609.078603:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788744609.078952:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c068a80 x1875634475283200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744609.078974:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475283200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744609.198706:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744609.198844:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744609.199082:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451132160 00000100:00100000:0.0:1788744609.199094:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451132160 00000100:00100000:0.0:1788744609.199203:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:0.0:1788744609.199216:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451132160:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744609.199295:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451132160:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 83us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744609.199303:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00080000:1.0:1788744609.200397:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744609.200960:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451132032 00000100:00100000:3.0:1788744609.200969:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451132032 00000100:00100000:3.0:1788744609.201018:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 221 00000100:00100000:3.0:1788744609.201025:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2359:x1875634451132032:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744609.201168:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2359:x1875634451132032:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 143us (2487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744609.201173:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 221 00000100:00100000:0.0:1788744609.201279:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744609.201370:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744609.201392:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744609.201523:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451132288 00000100:00100000:3.0:1788744609.201527:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451132288 00000100:00100000:3.0:1788744609.201557:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:3.0:1788744609.201562:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451132288:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744609.201599:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451132288:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 37us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744609.201603:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:3.0:1788744609.201617:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451132416 00000100:00100000:3.0:1788744609.201619:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451132416 00000100:00100000:3.0:1788744609.201636:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451132544 00000100:00100000:3.0:1788744609.201637:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451132544 00000100:00100000:3.0:1788744609.201650:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:3.0:1788744609.201653:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451132416:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744609.201670:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451132416:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 17us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744609.201674:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:3.0:1788744609.201681:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:3.0:1788744609.201684:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451132544:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744609.201711:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451132544:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 26us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744609.201717:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00080000:3.0:1788744609.201758:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744609.201770:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744609.201773:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744609.588642:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475283328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744609.588711:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744609.588913:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475283328 00000100:00100000:0.0:1788744609.588921:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475283328 00000100:00100000:0.0:1788744609.588977:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788744609.588986:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c069180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475283328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744609.589041:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744609.589090:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c069180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475283328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744609.589097:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788744609.589167:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd3f100 x1875634475283328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744609.589184:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475283328:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788744609.727851:0:10313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788744609.912542:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744610.941036:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744611.956359:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744612.983701:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744613.691601:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475283456:0@lo:400:kworker.0 00000100:00100000:3.0:1788744613.691681:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744613.691730:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475283968:0@lo:400:kworker.0 00000100:00100000:3.0:1788744613.691759:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744613.691785:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744613.691791:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475283840:0@lo:400:kworker.0 00000100:00100000:3.0:1788744613.691814:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744613.691837:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475283584:0@lo:400:kworker.0 00000100:00100000:3.0:1788744613.691876:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744613.691910:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475284096:0@lo:400:kworker.0 00000100:00100000:3.0:1788744613.691933:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744613.691953:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744613.691959:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475283712:0@lo:400:kworker.0 00000100:00100000:3.0:1788744613.691982:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744613.692016:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475283968 00000100:00100000:3.0:1788744613.692023:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475283968 00000100:00100000:3.0:1788744613.692070:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475283584 00000100:00100000:3.0:1788744613.692074:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475283584 00000100:00100000:3.0:1788744613.692090:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475283712 00000100:00100000:3.0:1788744613.692092:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475283712 00000100:00100000:3.0:1788744613.692112:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788744613.692121:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475283968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744613.692206:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475283968:12345-0@lo:400:kworker.0 Request processed in 86us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744613.692522:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788744613.692543:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788744613.692549:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475283584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744613.692589:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475283584:12345-0@lo:400:kworker.0 Request processed in 40us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744613.692595:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788744613.692608:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788744613.692615:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475283712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744613.692642:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475283712:12345-0@lo:400:kworker.0 Request processed in 29us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744613.692659:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788744613.692681:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475283840 00000100:00100000:3.0:1788744613.692686:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475283840 00000100:00100000:3.0:1788744613.692711:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475284096 00000100:00100000:3.0:1788744613.692714:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475284096 00000100:00100000:3.0:1788744613.692733:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788744613.692740:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475283840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744613.692771:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475283840:12345-0@lo:400:kworker.0 Request processed in 31us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744613.692777:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788744613.692788:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788744613.692794:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475284096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744613.692823:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475284096:12345-0@lo:400:kworker.0 Request processed in 29us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744613.692829:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788744613.692864:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744613.692868:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744613.692871:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744613.692919:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475283712:0@lo:400:kworker.0 00000100:00100000:3.0:1788744613.692931:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475283584:0@lo:400:kworker.0 00010000:00080000:3.0:1788744613.692941:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c078700 x1875634475284096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744613.692952:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475284096:0@lo:400:kworker.0 00010000:00080000:3.0:1788744613.692986:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c078000 x1875634475283840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744613.692996:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475283840:0@lo:400:kworker.0 00000100:00100000:3.0:1788744613.693007:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475283968:0@lo:400:kworker.0 00000100:00100000:0.0:1788744613.701739:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475283456 00000100:00100000:0.0:1788744613.701754:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475283456 00000100:00100000:0.0:1788744613.701809:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788744613.701818:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475283456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744613.705657:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475283456:12345-0@lo:400:kworker.0 Request processed in 3820us (13955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744613.705673:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788744613.713158:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475283456:0@lo:400:kworker.0 00010000:00010000:0.0:1788744614.017354:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744614.199347:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744614.199370:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475284224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744614.199440:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744614.200893:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475284224 00000100:00100000:1.0:1788744614.200906:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475284224 00000100:00100000:1.0:1788744614.200975:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788744614.200985:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475284224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744614.201025:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744614.201202:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475284224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 218us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744614.201209:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788744614.204435:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c068700 x1875634475284224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744614.204465:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475284224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744614.312745:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744614.312787:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744614.312887:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451132672 00000100:00100000:3.0:1788744614.312897:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451132672 00000100:00100000:3.0:1788744614.312960:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 223 00000100:00100000:3.0:1788744614.312972:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2362:x1875634451132672:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744614.313044:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2362:x1875634451132672:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 74us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744614.313051:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 223 00000100:00100000:1.0:1788744614.315296:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744614.315339:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744614.315465:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451133184 00000100:00100000:3.0:1788744614.315476:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451133184 00000100:00100000:3.0:1788744614.315551:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:3.0:1788744614.315561:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d44a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451133184:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744614.315646:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d44a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451133184:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 87us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744614.315668:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00080000:2.0:1788744614.316676:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744614.334542:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744614.334596:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451133056 00000100:00100000:1.0:1788744614.334607:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451133056 00000100:00100000:1.0:1788744614.334677:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:1.0:1788744614.334687:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451133056:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744614.334761:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451133056:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 75us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744614.334769:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:0.0:1788744614.335332:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451132928 00000100:00100000:0.0:1788744614.335340:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451132928 00000100:00100000:0.0:1788744614.335376:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451132800 00000100:00100000:0.0:1788744614.335379:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451132800 00000100:00100000:0.0:1788744614.335396:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:0.0:1788744614.335402:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451132928:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744614.335456:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451132928:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 54us (22668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744614.335463:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:0.0:1788744614.335504:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00100000:0.0:1788744614.335511:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451132800:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744614.335539:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451132800:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 28us (20200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744614.335546:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00080000:2.0:1788744614.347863:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744614.347875:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744614.708372:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475284352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744614.708448:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744614.708578:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475284352 00000100:00100000:3.0:1788744614.708588:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475284352 00000100:00100000:3.0:1788744614.708658:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744614.708669:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475284352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744614.708709:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744614.714891:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475284352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6205us (6424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744614.714906:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788744614.718767:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd3ea00 x1875634475284352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744614.718793:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475284352:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788744615.036822:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744616.052342:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744617.076293:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744618.105209:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744618.805584:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475284864:0@lo:400:kworker.0 00000100:00100000:2.0:1788744618.805666:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744618.805727:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788744618.805734:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475284480:0@lo:400:kworker.0 00000100:00100000:2.0:1788744618.805772:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744618.805795:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475284992:0@lo:400:kworker.0 00000100:00100000:2.0:1788744618.806022:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744618.806052:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475284608:0@lo:400:kworker.0 00000100:00100000:2.0:1788744618.806078:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744618.806095:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475285120:0@lo:400:kworker.0 00000100:00100000:2.0:1788744618.806113:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744618.806145:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744618.806151:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475284736:0@lo:400:kworker.0 00000100:00100000:2.0:1788744618.806168:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744618.806196:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475284864 00000100:00100000:2.0:1788744618.806204:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475284864 00000100:00100000:2.0:1788744618.806255:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475285120 00000100:00100000:2.0:1788744618.806258:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475285120 00000100:00100000:2.0:1788744618.806282:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788744618.806291:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475284864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744618.806423:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475284864:12345-0@lo:400:kworker.0 Request processed in 133us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744618.806432:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788744618.806456:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788744618.806476:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475285120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744618.806511:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475285120:12345-0@lo:400:kworker.0 Request processed in 36us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744618.806516:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788744618.806536:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475284480 00000100:00100000:2.0:1788744618.806540:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475284480 00000100:00100000:2.0:1788744618.806576:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788744618.806584:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475284480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744618.806614:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475284480:12345-0@lo:400:kworker.0 Request processed in 31us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744618.806620:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788744618.806646:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475284992 00000100:00100000:2.0:1788744618.806650:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475284992 00000100:00100000:2.0:1788744618.806670:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475284608 00000100:00100000:2.0:1788744618.806673:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475284608 00000100:00100000:2.0:1788744618.806683:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475284736 00000100:00100000:2.0:1788744618.806685:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475284736 00000100:00100000:2.0:1788744618.806698:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788744618.806704:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475284992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744618.806731:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475284992:12345-0@lo:400:kworker.0 Request processed in 28us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744618.806737:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788744618.808138:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788744618.808157:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475284608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744618.808231:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475284608:12345-0@lo:400:kworker.0 Request processed in 80us (2151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744618.808238:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788744618.808265:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788744618.808273:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475284736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744618.808304:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475284736:12345-0@lo:400:kworker.0 Request processed in 33us (2135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744618.808310:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788744618.808995:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744618.809002:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744618.809005:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744618.809052:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475284480:0@lo:400:kworker.0 00000100:00100000:2.0:1788744618.809070:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475284992:0@lo:400:kworker.0 00010000:00080000:2.0:1788744618.809084:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c06f800 x1875634475284864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744618.809094:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475284864:0@lo:400:kworker.0 00000100:00100000:2.0:1788744618.809168:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475284736:0@lo:400:kworker.0 00000100:00100000:2.0:1788744618.809181:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475284608:0@lo:400:kworker.0 00010000:00080000:2.0:1788744618.809194:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c06d180 x1875634475285120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744618.809202:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475285120:0@lo:400:kworker.0 00010000:00010000:0.0:1788744619.128724:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744619.316891:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744619.316911:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475285248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744619.316976:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744619.317028:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475285248 00000100:00100000:1.0:1788744619.317040:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475285248 00000100:00100000:1.0:1788744619.317164:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788744619.317175:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475285248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744619.317234:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744619.317295:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475285248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744619.317302:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788744619.317345:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c06d180 x1875634475285248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744619.317365:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475285248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744619.437762:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744619.437834:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451133312 00000100:00100000:0.0:1788744619.437847:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451133312 00000100:00100000:0.0:1788744619.437916:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 225 00000100:00100000:0.0:1788744619.437928:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2360:x1875634451133312:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744619.438017:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2360:x1875634451133312:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 91us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744619.438025:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 225 00000100:00100000:1.0:1788744619.448744:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744619.448795:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744619.448827:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744619.448856:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744619.448891:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451133440 00000100:00100000:1.0:1788744619.448904:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451133440 00000100:00100000:1.0:1788744619.448964:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451133568 00000100:00100000:1.0:1788744619.448968:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451133568 00000100:00100000:1.0:1788744619.448986:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:1.0:1788744619.448995:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451133440:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744619.449063:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451133440:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 69us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744619.449071:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:1.0:1788744619.449086:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:1.0:1788744619.449092:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451133568:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744619.449127:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451133568:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 35us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744619.449148:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:1.0:1788744619.449165:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451133696 00000100:00100000:1.0:1788744619.449168:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451133696 00000100:00100000:1.0:1788744619.449189:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451133824 00000100:00100000:1.0:1788744619.449192:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451133824 00000100:00100000:1.0:1788744619.449211:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:1.0:1788744619.449229:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451133696:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744619.449254:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451133696:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 27us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744619.449260:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:1.0:1788744619.449272:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:1.0:1788744619.449277:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451133824:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744619.449295:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451133824:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 19us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744619.449300:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00080000:1.0:1788744619.449324:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744619.449328:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744619.449330:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744619.828319:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744619.828360:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475285376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744619.828437:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744619.828507:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475285376 00000100:00100000:0.0:1788744619.828516:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475285376 00000100:00100000:0.0:1788744619.828585:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788744619.828595:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475285376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744619.828634:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744619.828694:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475285376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744619.828702:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788744619.828743:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd3c700 x1875634475285376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744619.828761:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475285376:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788744620.158040:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744621.174951:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744622.197634:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744623.220570:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744623.924820:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475285888:0@lo:400:kworker.0 00000100:00100000:1.0:1788744623.924892:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744623.924950:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788744623.924957:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475285504:0@lo:400:kworker.0 00000100:00100000:1.0:1788744623.924986:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744623.925021:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475286016:0@lo:400:kworker.0 00000100:00100000:1.0:1788744623.925044:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744623.925071:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475285632:0@lo:400:kworker.0 00000100:00100000:1.0:1788744623.925093:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744623.925110:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475286144:0@lo:400:kworker.0 00000100:00100000:1.0:1788744623.925154:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744623.925172:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744623.925192:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475285760:0@lo:400:kworker.0 00000100:00100000:1.0:1788744623.925229:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744623.925265:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475285888 00000100:00100000:1.0:1788744623.925273:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475285888 00000100:00100000:1.0:1788744623.925322:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475286144 00000100:00100000:1.0:1788744623.925325:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475286144 00000100:00100000:1.0:1788744623.925347:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788744623.925355:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475285888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744623.925402:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475285888:12345-0@lo:400:kworker.0 Request processed in 48us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744623.925409:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788744623.925424:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788744623.925431:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475286144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744623.925461:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475286144:12345-0@lo:400:kworker.0 Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744623.925478:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788744623.925495:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475285504 00000100:00100000:1.0:1788744623.925499:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475285504 00000100:00100000:1.0:1788744623.925525:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788744623.925532:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475285504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744623.925561:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475285504:12345-0@lo:400:kworker.0 Request processed in 29us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744623.925567:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788744623.925592:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475286016 00000100:00100000:1.0:1788744623.925595:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475286016 00000100:00100000:1.0:1788744623.925616:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475285632 00000100:00100000:1.0:1788744623.925619:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475285632 00000100:00100000:1.0:1788744623.925629:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475285760 00000100:00100000:1.0:1788744623.925639:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475285760 00000100:00100000:1.0:1788744623.925659:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788744623.925665:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475286016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744623.925696:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475286016:12345-0@lo:400:kworker.0 Request processed in 32us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744623.925702:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788744623.925714:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788744623.925719:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475285632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744623.925744:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475285632:12345-0@lo:400:kworker.0 Request processed in 25us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744623.925750:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788744623.925760:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788744623.925765:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475285760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744623.925790:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475285760:12345-0@lo:400:kworker.0 Request processed in 24us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744623.925795:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788744623.925823:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744623.925826:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744623.925828:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744623.925867:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475285760:0@lo:400:kworker.0 00000100:00100000:1.0:1788744623.925878:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475285632:0@lo:400:kworker.0 00010000:00080000:1.0:1788744623.925889:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a204ff9180 x1875634475286144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744623.925901:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475286144:0@lo:400:kworker.0 00000100:00100000:1.0:1788744623.925931:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475285504:0@lo:400:kworker.0 00000100:00100000:1.0:1788744623.925951:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475286016:0@lo:400:kworker.0 00010000:00080000:1.0:1788744623.925961:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a204ffa680 x1875634475285888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744623.925968:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475285888:0@lo:400:kworker.0 00010000:00010000:0.0:1788744624.245018:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744624.444620:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475286272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744624.444719:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744624.444794:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475286272 00000100:00100000:2.0:1788744624.444801:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475286272 00000100:00100000:2.0:1788744624.444845:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788744624.444852:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475286272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744624.444888:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744624.444926:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475286272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744624.444933:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788744624.444974:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c06d180 x1875634475286272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744624.444991:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475286272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744624.556855:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744624.556892:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744624.556915:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744624.556939:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451134208 00000100:00100000:2.0:1788744624.556949:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451134208 00000100:00100000:2.0:1788744624.557004:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451134080 00000100:00100000:2.0:1788744624.557007:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451134080 00000100:00100000:2.0:1788744624.557027:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:2.0:1788744624.557038:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2361:x1875634451134208:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744624.557114:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2361:x1875634451134208:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 78us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744624.557122:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:2.0:1788744624.557157:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:2.0:1788744624.557163:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2361:x1875634451134080:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744624.557194:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2361:x1875634451134080:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 32us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744624.557200:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00080000:2.0:1788744624.557217:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744624.557540:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451133952 00000100:00100000:3.0:1788744624.557546:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451133952 00000100:00100000:3.0:1788744624.557584:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 227 00000100:00100000:3.0:1788744624.557592:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2361:x1875634451133952:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744624.557631:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2361:x1875634451133952:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 40us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744624.557636:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 227 00000100:00100000:2.0:1788744624.576735:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744624.576787:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744624.576890:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451134336 00000100:00100000:1.0:1788744624.576901:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451134336 00000100:00100000:1.0:1788744624.576974:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451134464 00000100:00100000:1.0:1788744624.576978:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451134464 00000100:00100000:1.0:1788744624.577004:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:1.0:1788744624.577014:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2358:x1875634451134336:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:1.0:1788744624.577049:0:6685:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391ffd 00000100:00080000:1.0:1788744624.577058:0:6685:0:(import.c:65:import_set_state_nolock()) ffff93a23f86d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744624.577096:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788744624.577517:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+2:2358:x1875634451134336:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 502us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744624.577536:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:1.0:1788744624.577553:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:1.0:1788744624.577561:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2358:x1875634451134464:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:1.0:1788744624.577574:0:6685:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391ff6 00000100:00080000:1.0:1788744624.577580:0:6685:0:(import.c:65:import_set_state_nolock()) ffff93a23cd65000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744624.577604:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788744624.577792:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+2:2358:x1875634451134464:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 231us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744624.577799:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00010000:00010000:1.0:1788744624.577828:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744624.578071:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788744624.578080:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744624.578084:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744624.948324:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475286400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744624.948394:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744624.948494:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475286400 00000100:00100000:2.0:1788744624.948503:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475286400 00000100:00100000:2.0:1788744624.948568:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788744624.948576:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475286400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744624.948612:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744624.948943:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475286400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 366us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744624.948951:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788744624.949013:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd3c700 x1875634475286400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744624.949032:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475286400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788744625.268661:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788744626.049410:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3d79cafb-2132-4187-a776-0e0ed417e77b 00000020:00000080:0.0:1788744626.049422:0:7638:0:(genops.c:885:class_export_put()) final put ffff93a23cd67800/3d79cafb-2132-4187-a776-0e0ed417e77b 00000020:00000080:3.0:1788744626.049504:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23cd67800/3d79cafb-2132-4187-a776-0e0ed417e77b for lustre-OST0001 00000020:00000080:3.0:1788744626.049561:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a23cd65000 for lustre-OST0001 00010000:00010000:0.0:1788744626.295887:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788744626.546979:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3d79cafb-2132-4187-a776-0e0ed417e77b 00000020:00000080:1.0:1788744626.546990:0:6709:0:(genops.c:885:class_export_put()) final put ffff93a23f86c800/3d79cafb-2132-4187-a776-0e0ed417e77b 00000020:00000080:3.0:1788744626.547057:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23f86c800/3d79cafb-2132-4187-a776-0e0ed417e77b for lustre-OST0000 00000020:00000080:3.0:1788744626.547107:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a23f86d000 for lustre-OST0000 00000001:02000400:0.0:1788744627.285650:0:11016:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788744627.318595:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744628.340232:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744629.053079:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475286912:0@lo:400:kworker.0 00000100:00100000:1.0:1788744629.053178:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744629.053235:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788744629.053242:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475286528:0@lo:400:kworker.0 00000100:00100000:1.0:1788744629.053275:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744629.053299:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475287040:0@lo:400:kworker.0 00000100:00100000:1.0:1788744629.053322:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744629.053348:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475286656:0@lo:400:kworker.0 00000100:00100000:1.0:1788744629.053370:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744629.053400:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475287168:0@lo:400:kworker.0 00000100:00100000:1.0:1788744629.053419:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744629.053435:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744629.053440:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475286784:0@lo:400:kworker.0 00000100:00100000:1.0:1788744629.053465:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744629.053496:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475286912 00000100:00100000:1.0:1788744629.053503:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475286912 00000100:00100000:1.0:1788744629.053556:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475287168 00000100:00100000:1.0:1788744629.053572:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475287168 00000100:00100000:1.0:1788744629.053600:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788744629.053608:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475286912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744629.053663:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475286912:12345-0@lo:400:kworker.0 Request processed in 55us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744629.053670:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788744629.053692:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788744629.053698:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475287168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744629.053729:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475287168:12345-0@lo:400:kworker.0 Request processed in 32us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744629.053735:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788744629.053758:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475286528 00000100:00100000:1.0:1788744629.053763:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475286528 00000100:00100000:1.0:1788744629.053785:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788744629.053792:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475286528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744629.053820:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475286528:12345-0@lo:400:kworker.0 Request processed in 29us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744629.053826:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788744629.053854:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475287040 00000100:00100000:1.0:1788744629.053858:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475287040 00000100:00100000:1.0:1788744629.053876:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475286656 00000100:00100000:1.0:1788744629.053878:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475286656 00000100:00100000:1.0:1788744629.053887:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475286784 00000100:00100000:1.0:1788744629.053889:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475286784 00000100:00100000:1.0:1788744629.053902:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788744629.053909:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475287040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744629.053938:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475287040:12345-0@lo:400:kworker.0 Request processed in 30us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744629.053950:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788744629.053962:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788744629.053967:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475286656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744629.053996:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475286656:12345-0@lo:400:kworker.0 Request processed in 28us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744629.054001:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788744629.054013:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788744629.054019:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475286784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744629.054043:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475286784:12345-0@lo:400:kworker.0 Request processed in 25us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744629.054048:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1788744629.054072:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744629.054077:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744629.054079:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744629.054113:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475286784:0@lo:400:kworker.0 00000100:00100000:1.0:1788744629.054123:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475286656:0@lo:400:kworker.0 00010000:00080000:1.0:1788744629.054157:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23d43a680 x1875634475287168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744629.054167:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475287168:0@lo:400:kworker.0 00000100:00100000:1.0:1788744629.054200:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475286528:0@lo:400:kworker.0 00000100:00100000:1.0:1788744629.054209:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475287040:0@lo:400:kworker.0 00010000:00080000:1.0:1788744629.054220:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23d43ad80 x1875634475286912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744629.054239:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475286912:0@lo:400:kworker.0 00010000:00010000:1.0:1788744629.364498:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744629.557309:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744629.557335:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475287296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744629.557432:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744629.557549:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475287296 00000100:00100000:2.0:1788744629.557567:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475287296 00000100:00100000:2.0:1788744629.557635:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788744629.557645:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475287296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744629.557690:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744629.560819:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475287296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3165us (3376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744629.560835:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788744629.560935:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c06e300 x1875634475287296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744629.560961:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475287296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744629.669698:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744629.669738:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744629.669778:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744629.670757:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451134848 00000100:00100000:3.0:1788744629.670781:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451134848 00000100:00100000:3.0:1788744629.670847:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451134720 00000100:00100000:3.0:1788744629.670851:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451134720 00000100:00100000:3.0:1788744629.670874:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 89 00000100:00100000:3.0:1788744629.670883:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451134848:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744629.670965:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451134848:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 83us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744629.670971:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 89 00000100:00100000:3.0:1788744629.670990:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 90 00000100:00100000:3.0:1788744629.670996:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451134720:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744629.671021:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451134720:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 25us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744629.671026:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 90 00000100:00100000:1.0:1788744629.671232:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451134592 00000100:00100000:1.0:1788744629.671238:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451134592 00000100:00100000:1.0:1788744629.671277:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 229 00000100:00100000:1.0:1788744629.671285:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2362:x1875634451134592:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744629.671320:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2362:x1875634451134592:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 36us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744629.671326:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 229 00000100:00080000:0.0:1788744629.672245:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744630.073892:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475287424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744630.073977:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744630.074102:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475287424 00000100:00100000:2.0:1788744630.074160:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475287424 00000100:00100000:2.0:1788744630.074227:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788744630.074236:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475287424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744630.074284:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744630.074343:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475287424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744630.074350:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788744630.074457:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a106fb4380 x1875634475287424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744646 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744630.074477:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475287424:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788744630.394714:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788744630.698659:0:11163:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffddbc84710 20000000:00000080:2.0:1788744630.698677:0:11163:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93a220782800 uarg=0000000000000000 20000000:01000000:2.0:1788744630.698712:0:11163:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788744630.698718:0:11163:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788744630.698722:0:11163:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788744630.700247:0:11164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788744630.700327:0:11163:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788744630.707105:0:11163:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788744630.707429:0:11163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93a2064f2800/0x4b162761eb392004 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.707451:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a201472e00/0x4b162761eb391f47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54dae expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.707461:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a23d17f600/0x4b162761eb391f71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391f6a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.707468:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a23d17f800/0x4b162761eb391f9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391f94 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.707474:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a107e81c00/0x4b162761eb391fc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb391fbe expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.707497:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a2064f2c00/0x4b162761eb391fe8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54de6 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.707505:0:11163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93a2064f2800/0x4b162761eb392004 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.707547:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a2064f2c00/0x4b162761eb391fe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54de6 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.707562:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93a2064f2c00/0x4b162761eb391fe8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54de6 expref: 12 pid: 5833 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744630.707577:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875634475287552:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744630.707692:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a107e81c00/0x4b162761eb391fc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391fbe expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.707701:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a107e81c00/0x4b162761eb391fc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391fbe expref: 18 pid: 5834 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744630.707710:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875634475287680:0@lo:104: 00000100:00100000:2.0:1788744630.707752:0:11163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744630.707794:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a23d17f800/0x4b162761eb391f9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391f94 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.707802:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a23d17f800/0x4b162761eb391f9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391f94 expref: 18 pid: 5835 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744630.707810:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875634475287808:0@lo:104: 00000100:00100000:2.0:1788744630.707852:0:11163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744630.707876:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a23d17f600/0x4b162761eb391f71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb391f6a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744630.707881:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475287680 00010000:00010000:2.0:1788744630.707884:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a23d17f600/0x4b162761eb391f71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb391f6a expref: 18 pid: 5835 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744630.707892:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475287680 00000100:00100000:2.0:1788744630.707896:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875634475287936:0@lo:104: 00000100:00100000:1.0:1788744630.707941:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475287808 00000100:00100000:1.0:1788744630.707945:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475287808 00000100:00100000:2.0:1788744630.707947:0:11163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744630.707962:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475287936 00000100:00100000:1.0:1788744630.707966:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475287936 00010000:00010000:2.0:1788744630.707976:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a201472e00/0x4b162761eb391f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54dae expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744630.707985:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1788744630.707992:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93a201472e00/0x4b162761eb391f47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54dae expref: 12 pid: 5834 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744630.707999:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+5:11163:x1875634475287680:12345-0@lo:104: 00000100:00100000:2.0:1788744630.708006:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d44700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875634475288064:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744630.708017:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a201473000/0x4b162761eb391fbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391fc5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744630.708035:0:11163:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23d211840 going to sleep for 11 seconds 00010000:00010000:1.0:1788744630.708103:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788744630.708110:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+5:11163:x1875634475287680:12345-0@lo:104: Request processed in 115us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744630.708117:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744630.708161:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788744630.708170:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+4:11163:x1875634475287808:12345-0@lo:104: 00010000:00010000:1.0:1788744630.708185:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a23d17ec00/0x4b162761eb391f94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391f9b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.708225:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788744630.708231:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+4:11163:x1875634475287808:12345-0@lo:104: Request processed in 64us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744630.708237:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788744630.708251:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744630.708258:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+3:11163:x1875634475287936:12345-0@lo:104: 00010000:00010000:1.0:1788744630.708265:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a23d17ee00/0x4b162761eb391f6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391f71 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.708301:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788744630.708308:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+3:11163:x1875634475287936:12345-0@lo:104: Request processed in 52us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744630.708313:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788744630.708324:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788744630.708333:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744630.708334:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a201473000/0x4b162761eb391fbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391fc5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.708340:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a23d17ec00/0x4b162761eb391f94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391f9b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744630.708345:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201473000 already unused, calling callback (ffffffffc1c2dc20) 00010000:00010000:1.0:1788744630.708360:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ec00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1788744630.708362:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a201473000/0x4b162761eb391fbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391fc5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744630.708365:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17ec00/0x4b162761eb391f94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391f9b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744630.708381:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a201473000/0x4b162761eb391fbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391fc5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.708382:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a23d17ec00/0x4b162761eb391f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391f9b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744630.708401:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a201473000/0x4b162761eb391fbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391fc5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744630.708402:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17ec00/0x4b162761eb391f94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391f9b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744630.708410:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788744630.708422:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788744630.708456:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a201473000/0x4b162761eb391fbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391fc5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744630.708463:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744630.708484:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a201473000/0x4b162761eb391fbe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391fc5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744630.708490:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a201473000/0x4b162761eb391fbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391fc5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744630.708505:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744630.708508:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a23d17ee00/0x4b162761eb391f6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb391f71 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744630.708514:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ee00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1788744630.708524:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17ee00/0x4b162761eb391f6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb391f71 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744630.708530:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a23d17ee00/0x4b162761eb391f6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb391f71 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744630.708536:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17ee00/0x4b162761eb391f6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb391f71 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744630.708541:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788744630.708748:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875634475287680:0@lo:104: 00000100:00100000:2.0:1788744630.708758:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875634475287808:0@lo:104: 00000100:00100000:2.0:1788744630.708764:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875634475287936:0@lo:104: 00010000:00010000:1.0:1788744630.708965:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a23d17ec00/0x4b162761eb391f94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391f9b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.708972:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744630.708983:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a23d17ee00/0x4b162761eb391f6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391f71 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744630.708991:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744630.709002:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a23d17ec00/0x4b162761eb391f94 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391f9b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.709011:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a23d17ec00/0x4b162761eb391f94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391f9b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.709023:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744630.709026:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744630.709028:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744630.709032:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475288320:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744630.709038:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744630.709071:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744630.709112:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744630.709118:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475288448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744630.709162:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744630.709196:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475288320 00000100:00100000:2.0:1788744630.709203:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475288320 00010000:00010000:2.0:1788744630.709237:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a23d17f800/0x4b162761eb391f9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391f94 expref: 19 pid: 5835 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744630.709261:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475288448 00000100:00100000:2.0:1788744630.709264:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475288448 00010000:00010000:2.0:1788744630.709275:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a23d17f600/0x4b162761eb391f71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391f6a expref: 20 pid: 5835 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744630.709293:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788744630.709301:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+20:3309:x1875634475288320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744630.709314:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744630.709320:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a23d17f800/0x4b162761eb391f9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391f94 expref: 20 pid: 5835 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.709330:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a23d17f800/0x4b162761eb391f9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391f94 expref: 20 pid: 5835 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.709346:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a23d17f800/0x4b162761eb391f9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391f94 expref: 20 pid: 5835 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.709372:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744630.709403:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202e08c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3309:x1875634475288320:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744630.709409:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788744630.709463:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788744630.709470:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+18:3309:x1875634475288448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744630.709478:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744630.709482:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a23d17f600/0x4b162761eb391f71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391f6a expref: 18 pid: 5835 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.709499:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a23d17f600/0x4b162761eb391f71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391f6a expref: 18 pid: 5835 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.709510:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a23d17f600/0x4b162761eb391f71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391f6a expref: 18 pid: 5835 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.709518:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744630.709539:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+17:3309:x1875634475288448:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744630.709545:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788744630.709578:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475288448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744630.709586:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475288320:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744630.709721:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a23d17ee00/0x4b162761eb391f6a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391f71 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744630.709729:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a23d17ee00/0x4b162761eb391f6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb391f71 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744630.709746:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744630.709748:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744630.709749:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744630.711478:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475288192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744630.711541:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744630.711780:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475288192 00000100:00100000:2.0:1788744630.711789:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475288192 00010000:00010000:2.0:1788744630.711824:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a107e81c00/0x4b162761eb391fc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391fbe expref: 17 pid: 5834 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744630.712118:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788744630.712152:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+17:3308:x1875634475288192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744630.712167:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744630.712174:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a107e81c00/0x4b162761eb391fc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb391fbe expref: 17 pid: 5834 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.712186:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a107e81c00/0x4b162761eb391fc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb391fbe expref: 17 pid: 5834 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.712204:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a107e81c00/0x4b162761eb391fc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb391fbe expref: 17 pid: 5834 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.712232:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744630.712278:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+16:3308:x1875634475288192:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744630.712285:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788744630.712391:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475288192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744630.714912:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744630.714955:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744630.714996:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451134976 00000100:00100000:1.0:1788744630.715007:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451134976 00010000:00010000:1.0:1788744630.715047:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a2064f2c00/0x4b162761eb391fe8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54de6 expref: 13 pid: 5833 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744630.715096:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451135104 00000100:00100000:1.0:1788744630.715100:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451135104 00010000:00010000:1.0:1788744630.715114:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a201472e00/0x4b162761eb391f47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54dae expref: 14 pid: 5834 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744630.715162:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875634475287552:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744630.715177:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d44700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875634475288064:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744630.715210:0:11163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93a2064f2800/0x4b162761eb392004 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744630.715273:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:3.0:1788744630.715285:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+14:2359:x1875634451134976:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744630.715303:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744630.715321:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a2064f2c00/0x4b162761eb391fe8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54de6 expref: 14 pid: 5833 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744630.715331:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a2064f2c00/0x4b162761eb391fe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54de6 expref: 14 pid: 5833 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744630.715347:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2064f2c00/0x4b162761eb391fe8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54de6 expref: 14 pid: 5833 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744630.715375:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744630.715398:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:1.0:1788744630.715409:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2359:x1875634451135104:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744630.715419:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744630.715425:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a201472e00/0x4b162761eb391f47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54dae expref: 13 pid: 5834 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744630.715433:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2359:x1875634451134976:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 150us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744630.715450:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00010000:00010000:1.0:1788744630.715453:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a201472e00/0x4b162761eb391f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54dae expref: 13 pid: 5834 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.715468:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a201472e00/0x4b162761eb391f47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54dae expref: 12 pid: 5834 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.715489:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93a2064f2800/0x4b162761eb392004 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.715498:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2064f2800/0x4b162761eb392004 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.715515:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a2064f2800/0x4b162761eb392004 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.715523:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a2064f2800/0x4b162761eb392004 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.715530:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93a2064f2800/0x4b162761eb392004 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.715537:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93a2064f2800/0x4b162761eb392004 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.715544:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2800 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744630.715548:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93a2064f2800/0x4b162761eb392004 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.715556:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93a2064f2800/0x4b162761eb392004 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.715773:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93a2064f2800/0x4b162761eb392004 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.715812:0:11163:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93a2064f2800/0x4b162761eb392004 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.715821:0:11163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93a2064f2800/0x4b162761eb392004 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744630.715828:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2064f2800/0x4b162761eb392004 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744630.715857:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744630.715901:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+11:2359:x1875634451135104:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 493us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744630.715910:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00010000:00010000:2.0:1788744631.414171:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744632.037432:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744632.037525:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451135232 00000100:00100000:1.0:1788744632.037536:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451135232 00000100:00100000:1.0:1788744632.037601:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 230 00000100:00100000:1.0:1788744632.037620:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+11:5602:x1875634451135232:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744632.037638:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744632.037658:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2027e7e00/0x4b162761eb39200b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e10 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744632.037688:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2027e7e00/0x4b162761eb39200b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e10 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744632.037700:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2027e7e00/0x4b162761eb39200b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e10 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744632.037709:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2027e7e00, rc 0) 00000100:00100000:1.0:1788744632.037786:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:5602:x1875634451135232:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 176us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744632.037794:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 230 10000000:01000000:0.0:1788744632.052234:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788744632.052245:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a104b55800 from 7 10000000:01000000:0.0:1788744632.052251:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744632.052298:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392012 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.052343:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392012 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.052355:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392012 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744632.052383:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475288576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744632.052457:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744632.052527:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a202ec3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788744632.052755:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475288576 00000100:00100000:1.0:1788744632.052764:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475288576 00000100:00100000:1.0:1788744632.052825:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788744632.052834:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475288576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744632.052848:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744632.052861:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2027e6c00/0x4b162761eb392019 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb392012 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744632.052884:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2027e6c00/0x4b162761eb392019 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb392012 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744632.052895:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2027e6c00/0x4b162761eb392019 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb392012 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744632.052904:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2027e6c00, rc 0) 00000100:00100000:1.0:1788744632.052944:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475288576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744632.052950:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788744632.053305:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475288576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744632.053320:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392012 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.053341:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392012 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb392019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744632.053407:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475288704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744632.053433:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744632.053454:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a202ec3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744632.053469:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475288704 00000100:00100000:0.0:1788744632.053473:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475288704 00000100:00100000:0.0:1788744632.053497:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788744632.053504:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475288704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744632.053956:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475288704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 450us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744632.053963:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788744632.054061:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475288704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744632.054110:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475288832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744632.054179:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744632.054198:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2036aea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744632.054419:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475288832 00000100:00100000:0.0:1788744632.054425:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475288832 00000100:00100000:0.0:1788744632.054449:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788744632.054456:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475288832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744632.055736:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475288832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1271us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744632.055749:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788744632.057818:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744632.058059:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451135360 00000100:00100000:3.0:1788744632.058070:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451135360 00000100:00100000:3.0:1788744632.058158:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 234 00000100:00100000:3.0:1788744632.058170:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:5602:x1875634451135360:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744632.063776:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475288832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788744632.065434:0:11198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:3.0:1788744632.065586:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:5602:x1875634451135360:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 7412us (7774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744632.065598:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 234 00000020:01000000:0.0:1788744632.065683:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788744632.065711:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744632.065724:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392012 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.065736:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392012 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744632.065748:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788744632.065751:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a210e7e800 from 7 10000000:01000000:0.0:1788744632.065753:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744632.065797:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e600/0x4b162761eb392020 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.065806:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23d17e600/0x4b162761eb392020 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.065817:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23d17e600/0x4b162761eb392020 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744632.065839:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475288960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744632.065893:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744632.069406:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475288960 00000100:00100000:1.0:1788744632.069424:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475288960 00000100:00100000:1.0:1788744632.069522:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788744632.069534:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475288960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744632.069554:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744632.069596:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2027e6400/0x4b162761eb392027 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb392020 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744632.069637:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2027e6400/0x4b162761eb392027 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb392020 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744632.069649:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2027e6400/0x4b162761eb392027 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb392020 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744632.069659:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2027e6400, rc 0) 00000100:00100000:1.0:1788744632.069734:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475288960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (3840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744632.069740:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788744632.072375:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744632.072496:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451135488 00000100:00100000:1.0:1788744632.072508:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451135488 00000100:00100000:1.0:1788744632.072560:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 236 00000100:00100000:1.0:1788744632.072570:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:5602:x1875634451135488:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744632.072821:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:5602:x1875634451135488:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 251us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744632.072828:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 236 00000100:00100000:3.0:1788744632.083563:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744632.088784:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a202ec3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744632.088949:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475288960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744632.088975:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23d17e600/0x4b162761eb392020 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.088988:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23d17e600/0x4b162761eb392020 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb392027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744632.089086:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475289088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744632.089315:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744632.089369:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a202ec3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744632.090338:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451135616 00000100:00100000:0.0:1788744632.090353:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451135616 00000100:00100000:0.0:1788744632.090408:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475289088 00000100:00100000:0.0:1788744632.090412:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475289088 00000100:00100000:0.0:1788744632.090431:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 237 00000100:00100000:0.0:1788744632.090440:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:5602:x1875634451135616:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744632.090460:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744632.090482:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a23d17ee00/0x4b162761eb39202e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e17 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.090514:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23d17ee00/0x4b162761eb39202e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e17 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.090526:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a23d17ee00/0x4b162761eb39202e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e17 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.090535:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17ee00, rc 0) 00000100:00100000:0.0:1788744632.090591:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:5602:x1875634451135616:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 152us (7040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744632.090625:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 237 00000100:00100000:0.0:1788744632.090654:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788744632.090660:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475289088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744632.090933:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475289088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (1617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744632.090939:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788744632.090979:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475289088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744632.091023:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475289216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744632.091371:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744632.091393:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475289216 00000100:00100000:0.0:1788744632.091398:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475289216 00000100:00100000:0.0:1788744632.091419:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788744632.091426:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475289216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744632.091559:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475289216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744632.091566:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788744632.093242:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a202ec3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744632.093283:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475289216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788744632.095507:0:11199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788744632.095610:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788744632.095637:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744632.095651:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e600/0x4b162761eb392020 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.095682:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23d17e600/0x4b162761eb392020 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744632.095694:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788744632.095696:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a203f6f000 from 7 10000000:01000000:0.0:1788744632.095699:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744632.095733:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17f600/0x4b162761eb392035 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.095741:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23d17f600/0x4b162761eb392035 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.095752:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23d17f600/0x4b162761eb392035 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744632.095776:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475289344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744632.095836:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744632.095871:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a202ec3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744632.095891:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475289344 00000100:00100000:0.0:1788744632.095897:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475289344 00000100:00100000:0.0:1788744632.095929:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788744632.095937:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475289344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744632.095951:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744632.095963:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a23d17f800/0x4b162761eb39203c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb392035 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.095984:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23d17f800/0x4b162761eb39203c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb392035 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.096006:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a23d17f800/0x4b162761eb39203c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb392035 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.096015:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17f800, rc 0) 00000100:00100000:0.0:1788744632.096050:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:5837:x1875634475289344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744632.096057:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788744632.096099:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475289344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744632.096113:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23d17f600/0x4b162761eb392035 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39203c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.096122:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23d17f600/0x4b162761eb392035 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb39203c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744632.096192:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475289472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744632.096216:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744632.096233:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a202ec3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744632.096244:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475289472 00000100:00100000:0.0:1788744632.096247:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475289472 00000100:00100000:0.0:1788744632.096263:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788744632.096268:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:5837:x1875634475289472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744632.096510:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:5837:x1875634475289472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744632.096517:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788744632.096540:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475289472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744632.096570:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475289600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744632.096602:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744632.096615:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a202ec3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744632.096625:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475289600 00000100:00100000:0.0:1788744632.096628:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475289600 00000100:00100000:0.0:1788744632.096643:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788744632.096648:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:5837:x1875634475289600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744632.096771:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:5837:x1875634475289600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744632.096778:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788744632.096810:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475289600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788744632.103339:0:11200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:3.0:1788744632.104528:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744632.104654:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451135744 00000100:00100000:2.0:1788744632.104665:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451135744 00000100:00100000:2.0:1788744632.104715:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 243 00000100:00100000:2.0:1788744632.104725:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:5602:x1875634451135744:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744632.105031:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:5602:x1875634451135744:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 307us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744632.105039:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 243 00000020:01000000:0.0:1788744632.105630:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788744632.105655:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744632.105666:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17f600/0x4b162761eb392035 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39203c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744632.105678:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23d17f600/0x4b162761eb392035 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39203c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744632.110673:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744632.110711:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451135872 00000100:00100000:3.0:1788744632.110722:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451135872 00000100:00100000:3.0:1788744632.110769:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 244 00000100:00100000:3.0:1788744632.110779:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:5602:x1875634451135872:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744632.110985:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:5602:x1875634451135872:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 206us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744632.110992:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 244 00010000:00010000:1.0:1788744632.437247:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744633.460232:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744634.165217:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475289728:0@lo:400:kworker.0 00000100:00100000:0.0:1788744634.165308:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744634.165350:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475289984:0@lo:400:kworker.0 00000100:00100000:0.0:1788744634.165352:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475290240:0@lo:400:kworker.0 00000100:00100000:0.0:1788744634.165376:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744634.165399:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744634.165408:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788744634.165413:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475289856:0@lo:400:kworker.0 00000100:00100000:2.0:1788744634.165416:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744634.165421:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475290112:0@lo:400:kworker.0 00000100:00100000:2.0:1788744634.165443:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744634.165443:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744634.165459:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475290368:0@lo:400:kworker.0 00000100:00100000:2.0:1788744634.165472:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475290240 00000100:00100000:0.0:1788744634.165477:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744634.165479:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475290240 00000100:00100000:0.0:1788744634.165505:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475289728 00000100:00100000:0.0:1788744634.165508:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475289728 00000100:00100000:2.0:1788744634.165519:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475289984 00000100:00100000:2.0:1788744634.165522:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475289984 00000100:00100000:2.0:1788744634.165532:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475289856 00000100:00100000:0.0:1788744634.165532:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788744634.165534:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475289856 00000100:00100000:0.0:1788744634.165539:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475289728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744634.165554:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788744634.165559:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475290240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744634.165585:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475290240:12345-0@lo:400:kworker.0 Request processed in 27us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744634.165585:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475289728:12345-0@lo:400:kworker.0 Request processed in 45us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744634.165592:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788744634.165592:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788744634.165609:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788744634.165615:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475289984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744634.165619:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788744634.165625:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788744634.165638:0:5840:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788744634.165642:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475289984:12345-0@lo:400:kworker.0 Request processed in 28us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744634.165645:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788744634.165649:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788744634.165651:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475289856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744634.165665:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475290112 00000100:00100000:2.0:1788744634.165668:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475290112 00000100:00100000:0.0:1788744634.165691:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475289856:12345-0@lo:400:kworker.0 Request processed in 40us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744634.165692:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475290368 00000100:00100000:2.0:1788744634.165695:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475290368 00000100:00100000:2.0:1788744634.165713:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788744634.165719:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475290112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744634.165758:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475290112:12345-0@lo:400:kworker.0 Request processed in 39us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744634.165764:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788744634.165775:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788744634.165781:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475290368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744634.165806:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475290368:12345-0@lo:400:kworker.0 Request processed in 25us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744634.165811:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788744634.165826:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744634.165829:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744634.165832:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788744634.165937:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a106fb6a00 x1875634475290112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744634.165950:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475290112:0@lo:400:kworker.0 00000100:00100000:2.0:1788744634.165973:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475289984:0@lo:400:kworker.0 00000100:00100000:0.0:1788744634.168328:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788744634.168423:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475289856:0@lo:400:kworker.0 00010000:00080000:0.0:1788744634.168441:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a106fb4700 x1875634475290368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744634.168452:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475290368:0@lo:400:kworker.0 00000100:00100000:0.0:1788744634.168462:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475289728:0@lo:400:kworker.0 00000100:00100000:0.0:1788744634.168471:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475290240:0@lo:400:kworker.0 00010000:00010000:0.0:1788744634.490746:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744634.676371:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744634.676393:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475290496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744634.676459:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744634.676541:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475290496 00000100:00100000:3.0:1788744634.676551:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475290496 00000100:00100000:3.0:1788744634.676601:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788744634.676610:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475290496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744634.676649:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744634.676692:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475290496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744634.676702:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788744634.676746:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a207ef3b80 x1875634475290496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744634.676784:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475290496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744634.806984:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744634.807030:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744634.807056:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744634.807087:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451136256 00000100:00100000:0.0:1788744634.807096:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451136256 00000100:00100000:0.0:1788744634.807166:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451136128 00000100:00100000:0.0:1788744634.807170:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451136128 00000100:00100000:0.0:1788744634.807200:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:0.0:1788744634.807210:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451136256:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744634.807290:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451136256:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 72us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744634.807298:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:0.0:1788744634.807314:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00100000:0.0:1788744634.807320:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451136128:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744634.807344:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451136128:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 25us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744634.807350:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00080000:0.0:1788744634.807368:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744634.807639:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451136000 00000100:00100000:1.0:1788744634.807645:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451136000 00000100:00100000:1.0:1788744634.807681:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 246 00000100:00100000:1.0:1788744634.807689:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2359:x1875634451136000:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744634.807723:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2359:x1875634451136000:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 35us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744634.807728:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 246 00000001:02000400:1.0:1788744635.183252:0:11364:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788744635.191257:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744635.191298:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475290624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744635.191520:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744635.196503:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475290624 00000100:00100000:3.0:1788744635.196520:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475290624 00000100:00100000:3.0:1788744635.196594:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788744635.196605:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475290624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744635.197042:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744635.197213:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475290624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 610us (5693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744635.197221:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788744635.204316:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a106fb4700 x1875634475290624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744651 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744635.204561:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475290624:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788744635.510036:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744636.533033:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744637.559077:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744638.580665:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788744639.085693:0:11464:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:30:36 (1788744636) === 00000100:00100000:1.0:1788744639.252658:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744639.252700:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744639.252738:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451136512 00000100:00100000:1.0:1788744639.252748:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451136512 00000100:00100000:1.0:1788744639.252805:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1788744639.252815:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:9675:x1875634451136512:12345-192.168.201.6@tcp:700:mkdir.0 00000100:00100000:1.0:1788744639.252889:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:9675:x1875634451136512:12345-192.168.201.6@tcp:700:mkdir.0 Request processed in 76us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744639.252896:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:0.0:1788744639.253062:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451136384 00000100:00100000:0.0:1788744639.253068:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451136384 00000100:00100000:0.0:1788744639.253831:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:0.0:1788744639.253840:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2360:x1875634451136384:12345-192.168.201.6@tcp:41:mkdir.0 00000004:00000024:0.0:1788744639.253869:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788744639.253921:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2360:x1875634451136384:12345-192.168.201.6@tcp:41:mkdir.0 Request processed in 84us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744639.253926:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00080000:0.0:1788744639.254374:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744639.262824:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744639.262871:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451136768 00000100:00100000:1.0:1788744639.262882:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451136768 00000100:00100000:1.0:1788744639.262939:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:1.0:1788744639.262949:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:9675:x1875634451136768:12345-192.168.201.6@tcp:36:mkdir.0 00010000:00010000:1.0:1788744639.263011:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744639.263098:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb391f24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d99 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.263115:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a203c30300) 00010000:00010000:1.0:1788744639.263348:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744639.263665:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb392043 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.263679:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb392043 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.263688:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb392043 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.263707:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb39204a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.263714:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb39204a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.263721:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb39204a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744639.268324:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788744639.268343:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb392043 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.268354:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb392043 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.268362:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb392043 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.268369:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e6000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744639.268373:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb392043 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.268382:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb392043 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.268397:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a203446e00) 00010000:00010000:1.0:1788744639.268401:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744639.268406:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb392043 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.268424:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb392043 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744639.268446:0:5842:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000008fc7cfff reply state 0000000029233f3b transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb39204a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744639.268456:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788744639.268559:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+7:9675:x1875634451136768:12345-192.168.201.6@tcp:36:mkdir.0 Request processed in 5607us (5738us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788744639.268569:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00010000:00010000:2.0:1788744639.274318:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb39204a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.274337:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb39204a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.274346:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb39204a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.274352:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e7400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744639.274371:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb39204a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.274380:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb39204a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.274398:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93a203446700) 00010000:00010000:2.0:1788744639.274401:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744639.274407:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb39204a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.274414:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb39204a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744639.279805:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744639.279870:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451136896 00000100:00100000:1.0:1788744639.279878:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451136896 00000100:00100000:1.0:1788744639.279932:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:1.0:1788744639.279942:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:9676:x1875634451136896:12345-192.168.201.6@tcp:101:chmod.0 00010000:00010000:1.0:1788744639.279965:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744639.279991:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb392051 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e1e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.280076:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb392058 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.280092:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb392058 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.280105:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb392058 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744639.280190:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788744639.280194:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744639.280260:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb392058 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.280284:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb392051 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e1e expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.280302:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb392058 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e1e expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.280310:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a203446f00) 00010000:00010000:1.0:1788744639.280313:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744639.280317:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2027e7200, rc 0) 00000100:00100000:1.0:1788744639.280389:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+7:9676:x1875634451136896:12345-192.168.201.6@tcp:101:chmod.0 Request processed in 448us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744639.280402:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:0.0:1788744639.282854:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744639.282934:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451137152 00000100:00100000:3.0:1788744639.282944:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451137152 00000100:00100000:3.0:1788744639.283007:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:3.0:1788744639.283018:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+7:9676:x1875634451137152:12345-192.168.201.6@tcp:36:chmod.0 00010000:00010000:3.0:1788744639.283091:0:11306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744639.283114:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb392058 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e1e expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.283318:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a203446f00) 00010000:00010000:3.0:1788744639.283331:0:11306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744639.283356:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39205f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.283368:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39205f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.283376:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39205f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744639.283653:0:11306:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000e333a813 reply state 000000004e7f9512 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39205f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744639.283661:0:11306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788744639.283668:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788744639.283773:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+8:9676:x1875634451137152:12345-192.168.201.6@tcp:36:chmod.0 Request processed in 757us (925us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788744639.283778:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:0.0:1788744639.285757:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475290880:0@lo:400:kworker.0 00000100:00100000:0.0:1788744639.285845:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744639.285896:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475291392:0@lo:400:kworker.0 00000100:00100000:0.0:1788744639.285921:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744639.285954:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788744639.285961:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475290752:0@lo:400:kworker.0 00000100:00100000:0.0:1788744639.286000:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744639.286021:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475291264:0@lo:400:kworker.0 00000100:00100000:0.0:1788744639.286044:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744639.286071:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475291008:0@lo:400:kworker.0 00000100:00100000:0.0:1788744639.286093:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744639.286113:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744639.286118:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475291136:0@lo:400:kworker.0 00000100:00100000:0.0:1788744639.286164:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744639.286208:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475290752 00000100:00100000:0.0:1788744639.286216:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475290752 00000100:00100000:0.0:1788744639.286263:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788744639.286272:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475290752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744639.286322:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475290752:12345-0@lo:400:kworker.0 Request processed in 51us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744639.286329:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788744639.286362:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475290880 00000100:00100000:0.0:1788744639.286366:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475290880 00000100:00100000:0.0:1788744639.286386:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475291264 00000100:00100000:0.0:1788744639.286389:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475291264 00000100:00100000:0.0:1788744639.286413:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475291008 00000100:00100000:0.0:1788744639.286416:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475291008 00000100:00100000:0.0:1788744639.286431:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788744639.286437:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475290880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744639.286468:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475290880:12345-0@lo:400:kworker.0 Request processed in 31us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744639.286474:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788744639.286487:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788744639.286493:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475291264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744639.286519:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475291264:12345-0@lo:400:kworker.0 Request processed in 27us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744639.286526:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788744639.286536:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788744639.286541:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475291008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744639.286570:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475291008:12345-0@lo:400:kworker.0 Request processed in 29us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744639.286585:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1788744639.286602:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744639.286635:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475291008:0@lo:400:kworker.0 00000100:00100000:0.0:1788744639.286663:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475290752:0@lo:400:kworker.0 00000100:00100000:0.0:1788744639.286672:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475291264:0@lo:400:kworker.0 00000100:00100000:0.0:1788744639.286680:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475290880:0@lo:400:kworker.0 00010000:00010000:3.0:1788744639.287480:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39205f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.287496:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39205f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.287512:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39205f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.287518:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744639.287523:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39205f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.287532:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39205f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.287548:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae600) 00010000:00010000:3.0:1788744639.287550:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788744639.287556:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39205f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.287562:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39205f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744639.287743:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475291392 00000100:00100000:2.0:1788744639.287751:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475291392 00000100:00100000:2.0:1788744639.287808:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475291136 00000100:00100000:2.0:1788744639.287812:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475291136 00000100:00100000:2.0:1788744639.287834:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788744639.287842:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475291392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744639.287904:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475291392:12345-0@lo:400:kworker.0 Request processed in 64us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744639.287910:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788744639.287929:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788744639.287934:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475291136:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788744639.288092:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744639.288096:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744639.288115:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475291136:12345-0@lo:400:kworker.0 Request processed in 31us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744639.288123:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788744639.288190:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd3b800 x1875634475291136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744639.288228:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475291136:0@lo:400:kworker.0 00010000:00080000:2.0:1788744639.288267:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd39180 x1875634475291392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744639.288278:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475291392:0@lo:400:kworker.0 00000100:00100000:0.0:1788744639.312891:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744639.313377:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451137280 00000100:00100000:2.0:1788744639.313511:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451137280 00000100:00100000:2.0:1788744639.313579:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:2.0:1788744639.313590:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+7:9677:x1875634451137280:12345-192.168.201.6@tcp:101:chown.0 00010000:00010000:2.0:1788744639.313619:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744639.313647:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392066 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e25 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.313722:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb39206d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.313736:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb39206d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.313751:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb39206d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744639.313789:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788744639.313794:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744639.313830:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb39206d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.313856:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392066 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e25 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.313894:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb39206d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e25 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.313904:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a209e2e000) 00010000:00010000:2.0:1788744639.313907:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744639.313910:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3c00, rc 0) 00000100:00100000:2.0:1788744639.314719:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+8:9677:x1875634451137280:12345-192.168.201.6@tcp:101:chown.0 Request processed in 1127us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744639.314728:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:1.0:1788744639.316958:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744639.317114:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451137408 00000100:00100000:0.0:1788744639.317363:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451137408 00000100:00100000:0.0:1788744639.317542:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:0.0:1788744639.317553:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+8:9677:x1875634451137408:12345-192.168.201.6@tcp:101:chown.0 00010000:00010000:0.0:1788744639.317575:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744639.317597:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e2c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317661:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39207b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317676:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39207b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317688:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39207b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317702:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392082 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317728:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317735:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317827:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392089 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317835:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392089 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317843:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392089 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744639.317872:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788744639.317876:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744639.317897:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392089 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317909:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39207b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317915:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39207b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317921:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39207b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317927:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ea00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744639.317931:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39207b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317945:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39207b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317958:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a209e2e000) 00010000:00010000:0.0:1788744639.317961:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744639.317965:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39207b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317985:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39207b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.317999:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.318004:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392082 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.318009:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392082 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.318014:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744639.318017:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392082 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.318022:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392082 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.318028:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93a203c30200) 00010000:00010000:0.0:1788744639.318031:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744639.318034:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392082 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.318050:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392082 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.318081:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e2c expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.318094:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392089 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e2c expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.318102:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93a203c30000) 00010000:00010000:0.0:1788744639.318104:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744639.318106:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17fa00, rc 0) 00000100:00100000:0.0:1788744639.318742:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+9:9677:x1875634451137408:12345-192.168.201.6@tcp:101:chown.0 Request processed in 1185us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744639.318752:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1788744639.323020:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744639.323481:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451137664 00000100:00100000:0.0:1788744639.323492:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451137664 00000100:00100000:0.0:1788744639.323549:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:0.0:1788744639.323559:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+9:9677:x1875634451137664:12345-192.168.201.6@tcp:36:chown.0 00010000:00010000:0.0:1788744639.323616:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744639.323643:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392089 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e2c expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.323666:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93a203c30000) 00010000:00010000:0.0:1788744639.323678:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744639.323705:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392090 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.323734:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392090 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.323745:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392090 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744639.360684:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1788744639.360807:0:5840:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000003c10d607 reply state 00000000aa15aa99 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392090 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744639.360823:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788744639.360837:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1788744639.360983:0:5840:0:(ldlm_lib.c:3495:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788744639.361009:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+7:9677:x1875634451137664:12345-192.168.201.6@tcp:36:chown.0 Request processed in 37446us (37993us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788744639.361019:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00010000:00010000:3.0:1788744639.361090:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392090 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.361099:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392090 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.361108:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392090 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.361114:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744639.361119:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392090 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.361175:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392090 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.361195:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93a203c30500) 00010000:00010000:3.0:1788744639.361206:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788744639.361213:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392090 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.361220:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392090 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744639.376172:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744639.376625:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451137792 00000100:00100000:3.0:1788744639.376638:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451137792 00000100:00100000:3.0:1788744639.376750:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:3.0:1788744639.376762:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+6:9678:x1875634451137792:12345-192.168.201.6@tcp:101:touch.500 00010000:00010000:3.0:1788744639.376787:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744639.376811:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb392097 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e33 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788744639.381278:0:11306:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4412us 00010000:00010000:2.0:1788744639.389999:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb39209e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390023:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb39209e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390036:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb39209e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390065:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3920a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390073:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3920a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390080:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3920a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390432:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2200/0x4b162761eb3920ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390442:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2200/0x4b162761eb3920ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390449:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2200/0x4b162761eb3920ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744639.390472:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788744639.390477:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744639.390517:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2200/0x4b162761eb3920ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390529:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb39209e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390536:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb39209e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390544:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb39209e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390561:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744639.390566:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb39209e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390575:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb39209e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390587:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a209e2e000) 00010000:00010000:2.0:1788744639.390591:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744639.390596:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb39209e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390602:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb39209e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390614:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3920a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390620:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3920a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390626:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3920a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390631:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744639.390634:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3920a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390640:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3920a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390659:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93a209e2ee00) 00010000:00010000:2.0:1788744639.390661:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744639.390665:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3920a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390671:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3920a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390712:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb392097 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e33 expref: 8 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390729:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2200/0x4b162761eb3920ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e33 expref: 7 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.390737:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:2.0:1788744639.390739:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788744639.390741:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2200, rc 0) 00000100:00100000:2.0:1788744639.390812:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+7:9678:x1875634451137792:12345-192.168.201.6@tcp:101:touch.500 Request processed in 14052us (14651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744639.390821:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:0.0:1788744639.403521:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744639.403716:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451138048 00000100:00100000:2.0:1788744639.403726:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451138048 00000100:00100000:2.0:1788744639.403786:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:2.0:1788744639.403797:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+7:9678:x1875634451138048:12345-192.168.201.6@tcp:101:touch.500 00010000:00010000:2.0:1788744639.403820:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744639.403840:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb3920b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e3a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.404151:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3920ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.404170:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3920ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.404183:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3920ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.404240:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3920c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.404249:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3920c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.404256:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3920c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744639.405250:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788744639.405883:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3920c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.405898:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3920c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.405909:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3920c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.405945:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3920ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.405965:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3920ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.405973:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3920ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.405980:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744639.405984:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3920ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.405991:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3920ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.406004:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:2.0:1788744639.406008:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744639.406013:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3920ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.406020:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3920ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744639.406035:0:5841:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000002dc39c48 reply state 000000003566c80d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3920c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744639.406045:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788744639.406085:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb3920b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e3a expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.406102:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3920c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e3a expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.406121:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:2.0:1788744639.406124:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744639.406347:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2c00, rc 0) 00000100:00100000:2.0:1788744639.406585:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+10:9678:x1875634451138048:12345-192.168.201.6@tcp:101:touch.500 Request processed in 2787us (3074us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788744639.406594:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:2.0:1788744639.414729:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744639.414818:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451138304 00000100:00100000:0.0:1788744639.414829:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451138304 00000100:00100000:0.0:1788744639.414888:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:0.0:1788744639.414899:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+10:9678:x1875634451138304:12345-192.168.201.6@tcp:36:touch.500 00010000:00010000:0.0:1788744639.414959:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744639.414986:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3920c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e3a expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.415005:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:0.0:1788744639.415016:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744639.415058:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3920d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.415071:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3920d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.415081:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3920d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744639.415246:0:5842:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000c8c7d70f reply state 00000000981cc3c7 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3920d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744639.415271:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788744639.415361:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+11:9678:x1875634451138304:12345-192.168.201.6@tcp:36:touch.500 Request processed in 463us (641us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788744639.415369:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00010000:00010000:3.0:1788744639.416868:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3920c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.416884:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3920c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.416892:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3920c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.416914:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744639.416919:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3920c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.416927:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3920c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.416941:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4cf2bfa5 (ffff93a209e2ea00) 00010000:00010000:3.0:1788744639.416944:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744639.416949:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3920c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.416955:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3920c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.417103:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3920d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.417111:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3920d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.417117:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3920d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.417122:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ec00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744639.417125:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3920d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.417285:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3920d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.417306:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93a203c30000) 00010000:00010000:3.0:1788744639.417309:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744639.417313:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3920d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.417319:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3920d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744639.418487:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744639.418716:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451138432 00000100:00100000:3.0:1788744639.418727:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451138432 00000100:00100000:3.0:1788744639.418788:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:3.0:1788744639.418800:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+9:9678:x1875634451138432:12345-192.168.201.6@tcp:101:touch.500 00010000:00010000:3.0:1788744639.418825:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744639.418845:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3920dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e41 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.418916:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3920dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e41 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.418929:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3920dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e41 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.418947:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93a21a9ae600) 00010000:00010000:3.0:1788744639.418950:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744639.418953:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81400, rc 0) 00000100:00100000:3.0:1788744639.419022:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+10:9678:x1875634451138432:12345-192.168.201.6@tcp:101:touch.500 Request processed in 224us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744639.419029:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:2.0:1788744639.422311:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744639.422392:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451138560 00000100:00100000:1.0:1788744639.422403:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451138560 00000100:00100000:1.0:1788744639.422462:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:1.0:1788744639.422470:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1875634451138560:12345-192.168.201.6@tcp:8:touch.500 00010000:00080000:1.0:1788744639.422507:0:9032:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:1.0:1788744639.422539:0:9032:0:(genops.c:1384:class_connect()) connect: client 390441fa-c0e0-4bda-b106-b1a75da212d8, cookie 0x4b162761eb3920e4 00002000:00100000:1.0:1788744639.422551:0:9032:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 390441fa-c0e0-4bda-b106-b1a75da212d8/ffff93a23cd66000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788744639.422577:0:9032:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:1.0:1788744639.422824:0:9032:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788744639.422857:0:9032:0:(import.c:65:import_set_state_nolock()) ffff93a23cd67000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744639.422931:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2358:x1875634451138560:12345-192.168.201.6@tcp:8:touch.500 Request processed in 460us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744639.422949:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:1.0:1788744639.425688:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744639.425762:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451138688 00000100:00100000:2.0:1788744639.425771:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451138688 00000100:00100000:2.0:1788744639.425838:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:2.0:1788744639.425848:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:0:x1875634451138688:12345-192.168.201.6@tcp:2:touch.500 00000100:00080000:0.0:1788744639.426218:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1788744639.451902:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 390441fa-c0e0-4bda-b106-b1a75da212d8 00000001:00080000:0.0:1788744639.451926:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1788744639.452151:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+5:0:x1875634451138688:12345-192.168.201.6@tcp:2:touch.500 Request processed in 26278us (26448us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788744639.452162:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:2.0:1788744639.454693:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744639.454791:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451138944 00000100:00100000:1.0:1788744639.454800:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451138944 00000100:00100000:1.0:1788744639.454889:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:1.0:1788744639.454901:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+10:9678:x1875634451138944:12345-192.168.201.6@tcp:35:touch.500 00000100:00100000:1.0:1788744639.455445:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+11:9678:x1875634451138944:12345-192.168.201.6@tcp:35:touch.500 Request processed in 545us (760us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788744639.455462:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:0.0:1788744639.470337:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744639.470451:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451139072 00000100:00100000:1.0:1788744639.470462:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451139072 00000100:00100000:1.0:1788744639.470517:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:1.0:1788744639.470527:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+11:9679:x1875634451139072:12345-192.168.201.6@tcp:101:rm.0 00010000:00010000:1.0:1788744639.470551:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744639.470574:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb3920eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e48 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.470646:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7800/0x4b162761eb3920f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.470660:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7800/0x4b162761eb3920f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.470672:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7800/0x4b162761eb3920f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744639.470711:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788744639.470731:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744639.470776:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7800/0x4b162761eb3920f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.470803:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb3920eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e48 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.470821:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7800/0x4b162761eb3920f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e48 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.470829:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:1.0:1788744639.470831:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744639.470835:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2027e7800, rc 0) 00000100:00100000:1.0:1788744639.470898:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+12:9679:x1875634451139072:12345-192.168.201.6@tcp:101:rm.0 Request processed in 372us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744639.470905:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:0.0:1788744639.474330:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744639.474534:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451139328 00000100:00100000:3.0:1788744639.474545:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451139328 00000100:00100000:3.0:1788744639.474650:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:3.0:1788744639.474659:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+12:9679:x1875634451139328:12345-192.168.201.6@tcp:101:rm.0 00010000:00010000:3.0:1788744639.474678:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744639.474696:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3920f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e4f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744639.474779:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788744639.474940:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3920f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e4f expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.474956:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a209e2e000) 00010000:00010000:3.0:1788744639.474958:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744639.474963:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3920f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e4f expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.474978:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80c00, rc 0) 00000100:00100000:3.0:1788744639.475045:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+13:9679:x1875634451139328:12345-192.168.201.6@tcp:101:rm.0 Request processed in 387us (727us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788744639.475053:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:2.0:1788744639.483480:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744639.483658:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451139456 00000100:00100000:3.0:1788744639.483669:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451139456 00000100:00100000:3.0:1788744639.483729:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:3.0:1788744639.483741:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+13:9679:x1875634451139456:12345-192.168.201.6@tcp:37:rm.0 00000100:00100000:3.0:1788744639.489059:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+13:9679:x1875634451139456:12345-192.168.201.6@tcp:37:rm.0 Request processed in 5308us (5578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744639.489089:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:0.0:1788744639.492844:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744639.493065:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451139712 00000100:00100000:1.0:1788744639.493076:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451139712 00000100:00100000:1.0:1788744639.493206:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:1.0:1788744639.493217:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a210e3b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+13:9679:x1875634451139712:12345-192.168.201.6@tcp:35:rm.0 00000100:00100000:1.0:1788744639.493470:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a210e3b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+14:9679:x1875634451139712:12345-192.168.201.6@tcp:35:rm.0 Request processed in 254us (634us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788744639.493477:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:2.0:1788744639.495869:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744639.495946:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451139968 00000100:00100000:0.0:1788744639.495955:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451139968 00000100:00100000:0.0:1788744639.496011:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:0.0:1788744639.496020:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+14:9679:x1875634451139968:12345-192.168.201.6@tcp:101:rm.0 00010000:00010000:0.0:1788744639.496042:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744639.496064:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392107 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e56 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.496187:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb39210e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.496210:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb39210e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.496221:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb39210e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744639.496232:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788744639.496608:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392107 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e56 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.496631:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb39210e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e56 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744639.496639:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:0.0:1788744639.496642:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788744639.496646:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17f200, rc 0) 00000100:00100000:0.0:1788744639.496714:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+16:9679:x1875634451139968:12345-192.168.201.6@tcp:101:rm.0 Request processed in 695us (855us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788744639.496722:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:0.0:1788744639.499195:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744639.499293:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451140096 00000100:00100000:3.0:1788744639.499304:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451140096 00000100:00100000:3.0:1788744639.499366:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:3.0:1788744639.499376:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+16:9679:x1875634451140096:12345-192.168.201.6@tcp:41:rm.0 00000004:00000024:3.0:1788744639.499457:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788744639.499526:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+16:9679:x1875634451140096:12345-192.168.201.6@tcp:41:rm.0 Request processed in 152us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744639.499534:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:2.0:1788744639.501752:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744639.501839:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451140224 00000100:00100000:3.0:1788744639.501849:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451140224 00000100:00100000:3.0:1788744639.501902:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:3.0:1788744639.501913:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+16:9679:x1875634451140224:12345-192.168.201.6@tcp:101:rm.0 00010000:00010000:3.0:1788744639.501933:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744639.501954:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39211c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e5d expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502019:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392123 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502036:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392123 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502047:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392123 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502062:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80000/0x4b162761eb39212a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502083:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80000/0x4b162761eb39212a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502090:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80000/0x4b162761eb39212a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502232:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb392131 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502242:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb392131 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502249:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb392131 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744639.502275:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788744639.502279:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744639.502298:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb392131 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502310:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb392131 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502319:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392123 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502326:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392123 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502332:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392123 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502350:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744639.502355:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392123 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502363:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392123 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502375:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:3.0:1788744639.502378:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744639.502384:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392123 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502390:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392123 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502405:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80000/0x4b162761eb39212a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502410:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80000/0x4b162761eb39212a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502416:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80000/0x4b162761eb39212a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502421:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744639.502423:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80000/0x4b162761eb39212a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502428:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80000/0x4b162761eb39212a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502444:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4cf2bfa5 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744639.502459:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744639.502463:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80000/0x4b162761eb39212a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502469:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80000/0x4b162761eb39212a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502499:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39211c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e5d expref: 18 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502511:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb392131 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e5d expref: 17 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.502518:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93a21a9ae600) 00010000:00010000:3.0:1788744639.502520:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744639.502523:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81600, rc 0) 00000100:00100000:3.0:1788744639.502634:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+17:9679:x1875634451140224:12345-192.168.201.6@tcp:101:rm.0 Request processed in 722us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744639.502642:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:2.0:1788744639.506209:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744639.506265:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451140480 00000100:00100000:3.0:1788744639.506277:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451140480 00000100:00100000:3.0:1788744639.506328:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:3.0:1788744639.506336:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+17:9679:x1875634451140480:12345-192.168.201.6@tcp:36:rm.0 00010000:00010000:3.0:1788744639.506396:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788744639.506420:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb392131 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e5d expref: 17 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.506462:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3920dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e41 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.506469:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93a21a9ae600) 00010000:00010000:3.0:1788744639.506483:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7800/0x4b162761eb3920f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e48 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.506493:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:3.0:1788744639.506495:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744639.506514:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81c00/0x4b162761eb392138 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.506528:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81c00/0x4b162761eb392138 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.506538:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81c00/0x4b162761eb392138 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.506550:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81e00/0x4b162761eb39213f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.506555:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81e00/0x4b162761eb39213f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.506559:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81e00/0x4b162761eb39213f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.506697:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392146 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.506715:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392146 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.506724:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392146 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744639.507513:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788744639.507524:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342206393651ns, next at 343206391418ns, rc = 0 00010000:00010000:3.0:1788744639.507580:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb39214d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507593:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb39214d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507601:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb39214d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507608:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb39214d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507615:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb39214d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507621:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb39214d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507644:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744639.507664:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392146 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507670:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392146 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507685:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392146 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507692:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744639.507697:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392146 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507705:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392146 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507716:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744639.507719:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788744639.507723:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392146 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507729:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392146 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.507734:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744639.507741:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb39214d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.507747:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81200 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744639.507748:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81c00/0x4b162761eb392138 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507754:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81c00/0x4b162761eb392138 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.507756:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb39214d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507761:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81c00/0x4b162761eb392138 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.507763:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb39214d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507766:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744639.507769:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81c00/0x4b162761eb392138 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.507772:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:2.0:1788744639.507774:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788744639.507777:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb39214d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507782:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81c00/0x4b162761eb392138 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.507783:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb39214d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.507791:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:3.0:1788744639.507792:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744639.507795:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81c00/0x4b162761eb392138 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.507798:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744639.507800:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744639.507801:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81c00/0x4b162761eb392138 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.507802:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1788744639.507809:0:5841:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000ae7cc0d4 reply state 0000000097a47175 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81e00/0x4b162761eb39213f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744639.507818:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744639.507907:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+16:9679:x1875634451140480:12345-192.168.201.6@tcp:36:rm.0 Request processed in 1567us (1714us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788744639.507915:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00010000:00010000:3.0:1788744639.511189:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81e00/0x4b162761eb39213f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.511217:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81e00/0x4b162761eb39213f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.511226:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81e00/0x4b162761eb39213f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.511233:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81e00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744639.511239:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81e00/0x4b162761eb39213f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.511268:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81e00/0x4b162761eb39213f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.511290:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4cf2bfa5 (ffff93a21a9aea00) 00010000:00010000:3.0:1788744639.511294:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744639.511299:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81e00/0x4b162761eb39213f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.511305:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81e00/0x4b162761eb39213f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4cf2bfa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744639.511759:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744639.511893:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451140736 00000100:00100000:3.0:1788744639.511906:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451140736 00000100:00100000:3.0:1788744639.511968:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:3.0:1788744639.511978:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+15:9679:x1875634451140736:12345-192.168.201.6@tcp:35:rm.0 00000100:00100000:3.0:1788744639.512281:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+16:9679:x1875634451140736:12345-192.168.201.6@tcp:35:rm.0 Request processed in 304us (526us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788744639.512290:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:2.0:1788744639.516101:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744639.516306:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451140992 00000100:00100000:3.0:1788744639.516316:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451140992 00000100:00100000:3.0:1788744639.516368:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:3.0:1788744639.516377:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+16:9679:x1875634451140992:12345-192.168.201.6@tcp:36:rm.0 00010000:00010000:3.0:1788744639.516618:0:11306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788744639.516648:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb39210e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e56 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.516670:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2200/0x4b162761eb3920ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e33 expref: 15 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.516698:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:3.0:1788744639.516716:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb39206d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e25 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.516724:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a209e2e000) 00010000:00010000:3.0:1788744639.516730:0:11306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744639.516756:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392154 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.516769:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392154 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.516778:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392154 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.516790:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39215b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.516797:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39215b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.516804:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39215b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.517063:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392162 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.517073:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392162 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.517091:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392162 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744639.518705:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788744639.518737:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392162 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.518748:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392162 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.518755:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392162 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.518761:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744639.518765:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392162 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.518785:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392162 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.518801:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93a21a9ae100) 00010000:00010000:2.0:1788744639.518803:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788744639.518808:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392162 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.518814:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392162 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.518843:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392154 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.518850:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392154 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.518855:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392154 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.518860:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744639.518862:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392154 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.518868:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392154 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.518875:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae600) 00010000:00010000:2.0:1788744639.518878:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744639.518881:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392154 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744639.518898:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392154 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744639.518914:0:11306:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000761854aa reply state 00000000d641ee75 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39215b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744639.518923:0:11306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744639.519069:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+15:9679:x1875634451140992:12345-192.168.201.6@tcp:36:rm.0 Request processed in 2688us (2972us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788744639.519079:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 31 00010000:00010000:3.0:1788744639.527558:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39215b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.527578:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39215b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.527587:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39215b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.527593:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744639.527598:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39215b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.527606:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39215b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.527624:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744639.527627:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744639.527632:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39215b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744639.527638:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81600/0x4b162761eb39215b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744639.604686:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744639.797211:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475291520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744639.797284:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744639.797562:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475291520 00000100:00100000:3.0:1788744639.797571:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475291520 00000100:00100000:3.0:1788744639.797625:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788744639.797635:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475291520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744639.797670:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744639.797727:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475291520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744639.797734:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788744639.797881:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a207ef1880 x1875634475291520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744639.797900:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475291520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744639.919556:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744639.919627:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744639.919662:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744639.919695:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744639.919941:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451141248 00000100:00100000:3.0:1788744639.919953:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451141248 00000100:00100000:3.0:1788744639.920018:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451141504 00000100:00100000:3.0:1788744639.920021:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451141504 00000100:00100000:3.0:1788744639.920059:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:3.0:1788744639.920069:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+14:2360:x1875634451141248:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744639.920207:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+14:2360:x1875634451141248:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 138us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744639.920215:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:3.0:1788744639.920238:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00100000:3.0:1788744639.920246:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2360:x1875634451141504:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744639.920280:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2360:x1875634451141504:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 36us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744639.920286:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00080000:3.0:1788744639.920305:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744639.920389:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451141120 00000100:00100000:0.0:1788744639.920394:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451141120 00000100:00100000:0.0:1788744639.920428:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 248 00000100:00100000:0.0:1788744639.920435:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2360:x1875634451141120:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744639.920468:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2360:x1875634451141120:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 34us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744639.920486:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 248 00000100:00100000:1.0:1788744639.920725:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451141376 00000100:00100000:1.0:1788744639.920731:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451141376 00000100:00100000:1.0:1788744639.920780:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:1.0:1788744639.920788:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2360:x1875634451141376:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744639.920821:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2360:x1875634451141376:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 35us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744639.920827:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:2.0:1788744640.308461:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744640.309675:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475291648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744640.309754:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744640.315959:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475291648 00000100:00100000:0.0:1788744640.315973:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475291648 00000100:00100000:0.0:1788744640.316037:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788744640.316049:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475291648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744640.316093:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744640.316210:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475291648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (6455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744640.316231:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788744640.316284:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd3a680 x1875634475291648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744656 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744640.316305:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475291648:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788744640.629586:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744641.653246:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744642.679943:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788744643.659006:0:11616:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788744643.711502:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744644.405063:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475292160:0@lo:400:kworker.0 00000100:00100000:3.0:1788744644.405204:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744644.405278:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744644.405285:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634475292032:0@lo:400:kworker.0 00000100:00100000:3.0:1788744644.405313:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744644.405368:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475292160 00000100:00100000:3.0:1788744644.405378:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475292160 00000100:00100000:3.0:1788744644.405449:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788744644.405460:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475292160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744644.405517:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475292160:12345-0@lo:400:kworker.0 Request processed in 59us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744644.405524:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788744644.405548:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475292032 00000100:00100000:3.0:1788744644.405552:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475292032 00000100:00100000:3.0:1788744644.405580:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788744644.405588:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634475292032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744644.405618:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634475292032:12345-0@lo:400:kworker.0 Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744644.405623:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1788744644.405640:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744644.405645:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744644.405682:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634475292032:0@lo:400:kworker.0 00010000:00080000:3.0:1788744644.405696:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a207ef1180 x1875634475292160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744644.405705:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475292160:0@lo:400:kworker.0 00000100:00100000:0.0:1788744644.405797:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475291904:0@lo:400:kworker.0 00000100:00100000:0.0:1788744644.405830:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744644.405859:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475292416:0@lo:400:kworker.0 00000100:00100000:0.0:1788744644.405881:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744644.405908:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788744644.405913:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475291776:0@lo:400:kworker.0 00000100:00100000:0.0:1788744644.405941:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744644.405965:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475292288:0@lo:400:kworker.0 00000100:00100000:0.0:1788744644.405988:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744644.406017:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475292416 00000100:00100000:0.0:1788744644.406022:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475292416 00000100:00100000:0.0:1788744644.406060:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788744644.406067:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475292416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744644.406105:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475292416:12345-0@lo:400:kworker.0 Request processed in 39us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744644.406123:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788744644.406167:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475291776 00000100:00100000:0.0:1788744644.406171:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475291776 00000100:00100000:0.0:1788744644.406195:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788744644.406201:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475291776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744644.406239:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475291776:12345-0@lo:400:kworker.0 Request processed in 38us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744644.406245:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788744644.406270:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475291904 00000100:00100000:0.0:1788744644.406273:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475291904 00000100:00100000:0.0:1788744644.406290:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475292288 00000100:00100000:0.0:1788744644.406292:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475292288 00000100:00100000:0.0:1788744644.406310:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788744644.406315:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475291904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744644.406340:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475291904:12345-0@lo:400:kworker.0 Request processed in 24us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744644.406345:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788744644.406354:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788744644.406359:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475292288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744644.406378:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475292288:12345-0@lo:400:kworker.0 Request processed in 19us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744644.406384:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1788744644.406408:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744644.406411:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744644.406427:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475291776:0@lo:400:kworker.0 00000100:00100000:0.0:1788744644.406436:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475292288:0@lo:400:kworker.0 00000100:00100000:0.0:1788744644.406443:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475291904:0@lo:400:kworker.0 00010000:00080000:0.0:1788744644.406453:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a207ef0000 x1875634475292416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744644.406463:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475292416:0@lo:400:kworker.0 00000001:00080000:1.0:1788744644.520284:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:1.0:1788744644.522505:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1788744644.522527:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788744644.522679:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475292544:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788744644.522748:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744644.522839:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475292544 00000100:00100000:1.0:1788744644.522846:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475292544 00000100:00100000:1.0:1788744644.522895:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788744644.522905:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475292544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788744644.522934:0:6684:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788744644.522970:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9e13be, atime: 0x6a9e13be, ctime: 0x6a9e13be, blocks: 0x1 00010000:00010000:1.0:1788744644.522979:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cdfce46/0x4b162761eb392169 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744644.522995:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1788744644.523000:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744644.523006:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cdfce46/0x4b162761eb392169 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744644.523039:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cdfce46/0x4b162761eb392169 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744644.523050:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cdfce46/0x4b162761eb392169 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744644.523058:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cdfce46/0x4b162761eb392169 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744644.523082:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744644.523150:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744644.523160:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cdfce46/0x4b162761eb392169 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744644.523171:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e7200 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744644.523176:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cdfce46/0x4b162761eb392169 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744644.523195:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cdfce46/0x4b162761eb392169 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744644.523216:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cdfce46/0x4b162761eb392169 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744644.523225:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cdfce46/0x4b162761eb392169 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744644.523252:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744644.523254:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744644.523257:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744644.524692:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875634475292544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1784us (1939us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788744644.524702:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788744644.524801:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93a23d439f80/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788744644.524810:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475292544:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788744644.728963:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788744644.905791:0:11666:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4ca73830 20000000:00000080:2.0:1788744644.905813:0:11666:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93a104b90c00 uarg=0000000000000000 20000000:01000000:2.0:1788744644.905853:0:11666:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788744644.905860:0:11666:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788744644.905865:0:11666:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788744644.907000:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788744644.907377:0:11666:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788744644.918989:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788744644.919047:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788744644.919124:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788744644.919210:0:11666:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788744644.919231:0:11666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93a107e80000/0x4b162761eb392170 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744644.919251:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a2027e7e00/0x4b162761eb39200b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e10 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744644.920949:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a2027e6c00/0x4b162761eb392019 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb392012 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744644.920957:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a2027e6400/0x4b162761eb392027 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb392020 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744644.920966:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a23d17ee00/0x4b162761eb39202e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e17 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744644.920973:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a23d17f800/0x4b162761eb39203c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb392035 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744644.920982:0:11666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93a107e80000/0x4b162761eb392170 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744644.921027:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a23d17f800/0x4b162761eb39203c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb392035 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744644.921044:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a23d17f800/0x4b162761eb39203c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb392035 expref: 18 pid: 5835 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744644.921072:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875634475292672:0@lo:104: 00000100:00100000:3.0:1788744644.921232:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788744644.921360:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a23d17ee00/0x4b162761eb39202e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e17 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744644.921371:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93a23d17ee00/0x4b162761eb39202e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e17 expref: 12 pid: 5835 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744644.921394:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875634475292800:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744644.921463:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a2027e6400/0x4b162761eb392027 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb392020 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744644.921473:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a2027e6400/0x4b162761eb392027 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb392020 expref: 18 pid: 5835 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744644.921482:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875634475292928:0@lo:104: 00000100:00100000:3.0:1788744644.921506:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744644.923422:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475293056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744644.923481:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744644.923532:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475293056 00000100:00100000:1.0:1788744644.923539:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475293056 00000100:00100000:1.0:1788744644.923591:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788744644.923601:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634475293056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744644.923643:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744644.924467:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634475293056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744644.924477:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788744644.929392:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475292672 00000100:00100000:0.0:1788744644.929413:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475292672 00000100:00100000:3.0:1788744644.931358:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:3.0:1788744644.931451:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a2027e6c00/0x4b162761eb392019 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb392012 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744644.931470:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93a2027e6c00/0x4b162761eb392019 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb392012 expref: 18 pid: 5833 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744644.931487:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875634475293184:0@lo:104: 00000100:00100000:3.0:1788744644.931542:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788744644.931575:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a2027e7e00/0x4b162761eb39200b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e10 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744644.931585:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93a2027e7e00/0x4b162761eb39200b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e10 expref: 12 pid: 5834 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744644.931595:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875634475293312:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744644.932079:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451141632 00000100:00100000:1.0:1788744644.932094:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451141632 00000100:00100000:3.0:1788744644.932484:0:11666:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23d609540 going to sleep for 11 seconds 00000100:00100000:3.0:1788744644.932512:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875634475292800:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744644.933053:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a23d17ee00/0x4b162761eb39202e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e17 expref: 13 pid: 5835 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744644.933095:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:1.0:1788744644.933216:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2359:x1875634451141632:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744644.933232:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744644.933238:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a23d17ee00/0x4b162761eb39202e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e17 expref: 13 pid: 5835 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744644.933248:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a23d17ee00/0x4b162761eb39202e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e17 expref: 13 pid: 5835 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744644.933267:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a23d17ee00/0x4b162761eb39202e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e17 expref: 13 pid: 5835 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744644.933283:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744644.933326:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:2359:x1875634451141632:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 222us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744644.933334:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:1.0:1788744644.933468:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475293056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744644.933582:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475292928 00000100:00100000:2.0:1788744644.933588:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475292928 00000100:00100000:2.0:1788744644.933639:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788744644.933649:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475293184 00000100:00100000:2.0:1788744644.933652:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475293184 00000100:00100000:2.0:1788744644.933669:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788744644.933676:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+5:11666:x1875634475292928:12345-0@lo:104: 00010000:00010000:2.0:1788744644.933688:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a23d17e600/0x4b162761eb392020 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb392027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744644.933774:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744644.933779:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+5:11666:x1875634475292928:12345-0@lo:104: Request processed in 105us (12273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744644.933786:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788744644.933803:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788744644.933809:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d15e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+4:11666:x1875634475293184:12345-0@lo:104: 00010000:00010000:2.0:1788744644.933818:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392012 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb392019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744644.933851:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875634475292928:0@lo:104: 00010000:00010000:1.0:1788744644.933976:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744644.933983:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a23d17e600/0x4b162761eb392020 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb392027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744644.933991:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e600 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1788744644.933995:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17e600/0x4b162761eb392020 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb392027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744644.934011:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a23d17e600/0x4b162761eb392020 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb392027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744644.934018:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17e600/0x4b162761eb392020 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb392027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744644.934023:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744644.934053:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a23d17e600/0x4b162761eb392020 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb392027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744644.934060:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744644.934080:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a23d17e600/0x4b162761eb392020 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb392027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744644.934087:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a23d17e600/0x4b162761eb392020 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb392027 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744644.934098:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744644.934100:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744644.934111:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744644.934155:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475293440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744644.936939:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744644.936960:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d15e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+4:11666:x1875634475293184:12345-0@lo:104: Request processed in 3145us (5411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744644.936972:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788744644.937006:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788744644.937016:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+3:11666:x1875634475292672:12345-0@lo:104: 00010000:00010000:2.0:1788744644.937033:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a23d17f600/0x4b162761eb392035 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb39203c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744644.937111:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1788744644.937443:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744644.937451:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392012 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb392019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.937460:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17fc00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1788744644.937465:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392012 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb392019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.937474:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392012 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb392019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744644.937482:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392012 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb392019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744644.937488:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788744644.937529:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392012 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb392019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.937536:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744644.937554:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392012 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb392019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.937561:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392012 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb392019 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.937596:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744644.937599:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a23d17f600/0x4b162761eb392035 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb39203c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.937605:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f600 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1788744644.937608:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17f600/0x4b162761eb392035 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb39203c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.937615:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a23d17f600/0x4b162761eb392035 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb39203c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744644.937622:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17f600/0x4b162761eb392035 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb39203c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744644.937684:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788744644.937701:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a23d17f600/0x4b162761eb392035 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb39203c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.937707:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744644.937732:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a23d17f600/0x4b162761eb392035 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb39203c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.937740:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a23d17f600/0x4b162761eb392035 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb39203c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.937754:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744644.937756:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744644.937757:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744644.937775:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475293568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744644.937827:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744644.938283:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475293568 00000100:00100000:0.0:1788744644.938291:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475293568 00010000:00010000:0.0:1788744644.938315:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a2027e6c00/0x4b162761eb392019 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb392012 expref: 19 pid: 5833 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744644.938341:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788744644.938350:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475293568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744644.938360:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744644.938366:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a2027e6c00/0x4b162761eb392019 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb392012 expref: 19 pid: 5833 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.938375:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a2027e6c00/0x4b162761eb392019 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb392012 expref: 19 pid: 5833 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.938417:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744644.938452:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475293568:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744644.938460:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788744644.939004:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475293568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744644.939052:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475293696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744644.939087:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744644.939193:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:754bab6b-7807-4d58-8a45-456ed56af02a+3:11666:x1875634475292672:12345-0@lo:104: Request processed in 2178us (17960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744644.939202:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788744644.939246:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744644.939354:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475293696 00000100:00100000:0.0:1788744644.939360:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475293696 00010000:00010000:0.0:1788744644.939380:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a23d17f800/0x4b162761eb39203c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb392035 expref: 19 pid: 5835 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744644.939415:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788744644.939436:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3309:x1875634475293696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744644.939449:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744644.939454:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a23d17f800/0x4b162761eb39203c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb392035 expref: 19 pid: 5835 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.939465:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a23d17f800/0x4b162761eb39203c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb392035 expref: 19 pid: 5835 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.939481:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744644.939511:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202e0b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3309:x1875634475293696:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744644.939516:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788744644.939572:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475293696:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744644.941437:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2027e6c00/0x4b162761eb392019 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb392012 expref: 18 pid: 5833 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744644.941463:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875634475293184:0@lo:104: 00010000:00010000:3.0:1788744644.941499:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a23d17f800/0x4b162761eb39203c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb392035 expref: 17 pid: 5835 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744644.941509:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875634475292672:0@lo:104: 00000100:00100000:2.0:1788744644.941673:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744644.941908:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451141760 00000100:00100000:0.0:1788744644.941915:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451141760 00010000:00010000:0.0:1788744644.941949:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a2027e7e00/0x4b162761eb39200b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e10 expref: 12 pid: 5834 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744644.941979:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:0.0:1788744644.941988:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:2360:x1875634451141760:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744644.942002:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744644.942007:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a2027e7e00/0x4b162761eb39200b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e10 expref: 12 pid: 5834 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.942016:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a2027e7e00/0x4b162761eb39200b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e10 expref: 12 pid: 5834 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.942038:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744644.942122:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:2360:x1875634451141760:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 115us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744644.942152:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:1.0:1788744644.942865:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744644.943073:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475293440 00000100:00100000:0.0:1788744644.943080:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475293440 00010000:00010000:0.0:1788744644.943111:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a2027e6400/0x4b162761eb392027 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb392020 expref: 17 pid: 5835 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744644.943168:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788744644.943175:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+17:3307:x1875634475293440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744644.943187:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744644.943191:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a2027e6400/0x4b162761eb392027 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb392020 expref: 17 pid: 5835 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.943201:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a2027e6400/0x4b162761eb392027 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb392020 expref: 17 pid: 5835 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.943216:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2027e6400/0x4b162761eb392027 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb392020 expref: 17 pid: 5835 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.943232:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93a107e80000/0x4b162761eb392170 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.943240:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e80000/0x4b162761eb392170 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.943257:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a107e80000/0x4b162761eb392170 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.943264:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a107e80000/0x4b162761eb392170 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.943287:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93a107e80000/0x4b162761eb392170 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.943294:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93a107e80000/0x4b162761eb392170 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.943300:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80000 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744644.943304:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93a107e80000/0x4b162761eb392170 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.943314:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93a107e80000/0x4b162761eb392170 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.943325:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93a107e80000/0x4b162761eb392170 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744644.943336:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744644.943375:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+16:3307:x1875634475293440:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744644.943382:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788744644.943560:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475293440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744644.944587:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2027e7e00/0x4b162761eb39200b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e10 expref: 11 pid: 5834 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744644.944607:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1875634475293312:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744644.944830:0:11666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93a107e80000/0x4b162761eb392170 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744644.944841:0:11666:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93a107e80000/0x4b162761eb392170 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744644.944847:0:11666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93a107e80000/0x4b162761eb392170 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744644.944854:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a107e80000/0x4b162761eb392170 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744645.019020:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:1.0:1788744645.029933:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744645.029977:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744645.030008:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744645.030109:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451141888 00000100:00100000:3.0:1788744645.030119:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451141888 00000100:00100000:2.0:1788744645.030152:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451142016 00000100:00100000:2.0:1788744645.030157:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451142016 00000100:00100000:3.0:1788744645.030194:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451142144 00000100:00100000:3.0:1788744645.030197:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451142144 00000100:00100000:2.0:1788744645.030198:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:2.0:1788744645.030208:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2359:x1875634451142016:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744645.030223:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 104 00000100:00100000:3.0:1788744645.030229:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2359:x1875634451141888:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744645.030292:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2359:x1875634451142016:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 85us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744645.030299:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:0.0:1788744645.030654:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 105 00000100:00100000:0.0:1788744645.030664:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451142144:12345-192.168.201.6@tcp:400:kworker.0 00000100:00080000:1.0:1788744645.030717:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744645.030722:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744645.038477:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451142144:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 7801us (8453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744645.038496:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 105 00000100:00100000:3.0:1788744645.040941:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2359:x1875634451141888:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 10700us (10951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744645.040959:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 104 00000100:00100000:1.0:1788744645.431925:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475293824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744645.432004:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744645.432176:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475293824 00000100:00100000:0.0:1788744645.432184:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475293824 00000100:00100000:0.0:1788744645.432236:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788744645.432242:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475293824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744645.432278:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744645.432328:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475293824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744645.432335:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788744645.432374:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd3b480 x1875634475293824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744645.432387:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475293824:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788744645.748645:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788744646.068263:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788744646.068272:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a104b55800 from 7 10000000:01000000:0.0:1788744646.068277:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744646.068327:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744646.068341:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744646.068352:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744646.068380:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475293952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744646.068455:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744646.068523:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23d211840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744646.069268:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475293952 00000100:00100000:3.0:1788744646.069278:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475293952 00000100:00100000:3.0:1788744646.069342:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788744646.069352:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a203d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+16:5837:x1875634475293952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744646.069368:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744646.069385:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e81600/0x4b162761eb39217e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb392177 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744646.069414:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e81600/0x4b162761eb39217e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb392177 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744646.069426:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e81600/0x4b162761eb39217e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb392177 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744646.069437:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81600, rc 0) 00000100:00100000:3.0:1788744646.069502:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a203d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475293952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744646.069508:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788744646.069832:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475293952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744646.069849:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39217e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744646.069859:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb39217e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744646.069918:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c068a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475294080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744646.069966:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744646.070001:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2049c6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788744646.070059:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475294080 00000100:00100000:0.0:1788744646.070063:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475294080 00000100:00100000:0.0:1788744646.070111:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788744646.070118:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a203d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475294080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744646.070397:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a203d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475294080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744646.070405:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788744646.070483:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c068a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475294080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744646.070520:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475294208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744646.070557:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744646.070584:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23d544600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744646.070646:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475294208 00000100:00100000:3.0:1788744646.070650:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475294208 00000100:00100000:3.0:1788744646.070669:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788744646.070675:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475294208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744646.070811:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475294208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744646.070823:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788744646.070893:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475294208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744646.072246:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d44000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:11680:1875634475294336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744646.072307:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744646.072348:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23d544900 going to sleep for 11 seconds 00000100:00100000:3.0:1788744646.072413:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475294336 00000100:00100000:3.0:1788744646.072420:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475294336 00000100:00100000:3.0:1788744646.072461:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788744646.072469:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+17:11680:x1875634475294336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744646.072656:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+17:11680:x1875634475294336:12345-0@lo:502:llog_process_th.0 Request processed in 187us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744646.072662:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788744646.072786:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d44000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:11680:1875634475294336:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744646.072813:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744646.072823:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744646.072826:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788744646.072833:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93a104b55800 00000020:00000080:2.0:1788744646.072836:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788744646.072915:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d44000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:11680:1875634475294464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744646.072958:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744646.072983:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23d544900 going to sleep for 11 seconds 00000100:00100000:1.0:1788744646.073035:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475294464 00000100:00100000:1.0:1788744646.073039:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475294464 00000100:00100000:1.0:1788744646.073069:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788744646.073075:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+17:11680:x1875634475294464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744646.073246:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+17:11680:x1875634475294464:12345-0@lo:502:llog_process_th.0 Request processed in 170us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744646.073253:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788744646.077308:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d44000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:11680:1875634475294464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744646.077364:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744646.077385:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744646.077388:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788744646.077394:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788744646.077772:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788744646.077794:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744646.077804:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39217e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744646.077815:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39217e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744646.077827:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788744646.077839:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a210e7e800 from 7 10000000:01000000:1.0:1788744646.077843:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744646.077887:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744646.077896:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744646.077906:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744646.077942:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475294592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744646.078013:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744646.078064:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2049c6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744646.078161:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475294592 00000100:00100000:3.0:1788744646.078168:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475294592 00000100:00100000:3.0:1788744646.078213:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788744646.078222:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+17:5837:x1875634475294592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744646.078239:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744646.078256:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e80000/0x4b162761eb39218c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb392185 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744646.078281:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e80000/0x4b162761eb39218c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb392185 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744646.078292:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e80000/0x4b162761eb39218c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb392185 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744646.078301:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80000, rc 0) 00000100:00100000:3.0:1788744646.078342:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475294592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744646.078349:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788744646.078655:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475294592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744646.078670:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39218c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744646.078680:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb39218c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744646.078729:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475294720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744646.078755:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744646.078780:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23d544900 going to sleep for 11 seconds 00000100:00100000:1.0:1788744646.078840:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475294720 00000100:00100000:1.0:1788744646.078845:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475294720 00000100:00100000:1.0:1788744646.078881:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788744646.078888:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475294720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744646.079214:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475294720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744646.079223:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788744646.083795:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475294720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744646.083874:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475294848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744646.083981:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744646.084031:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23d544900 going to sleep for 11 seconds 00000100:00100000:0.0:1788744646.088043:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475294848 00000100:00100000:0.0:1788744646.088059:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475294848 00000100:00100000:0.0:1788744646.088160:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788744646.088172:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475294848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744646.088461:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475294848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 292us (4481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744646.088471:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788744646.088548:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475294848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744646.088749:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:11683:1875634475294976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744646.088790:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744646.088822:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475294976 00000100:00100000:0.0:1788744646.088826:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475294976 00000100:00100000:0.0:1788744646.088851:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788744646.088857:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+18:11683:x1875634475294976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744646.088982:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+18:11683:x1875634475294976:12345-0@lo:502:llog_process_th.0 Request processed in 124us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744646.088989:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788744646.089029:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23d211840 going to sleep for 11 seconds 00000100:00100000:0.0:1788744646.089040:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:11683:1875634475294976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744646.089060:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744646.089069:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744646.089076:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788744646.097594:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93a210e7e800 00000020:00000080:0.0:1788744646.097606:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788744646.097736:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:11683:1875634475295104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744646.097826:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744646.097876:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23d211840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744646.099192:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475295104 00000100:00100000:3.0:1788744646.099214:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475295104 00000100:00100000:3.0:1788744646.099277:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788744646.099288:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+18:11683:x1875634475295104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744646.099587:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+18:11683:x1875634475295104:12345-0@lo:502:llog_process_th.0 Request processed in 300us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744646.099595:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788744646.099731:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:11683:1875634475295104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744646.099770:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744646.099779:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744646.099781:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788744646.099792:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788744646.100222:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788744646.100245:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788744646.100256:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39218c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744646.100269:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39218c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744646.100281:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788744646.100284:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a203f6f000 from 7 10000000:01000000:3.0:1788744646.100286:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788744646.100318:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744646.100327:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744646.100336:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744646.100357:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475295232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744646.100396:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744646.100436:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23bcb3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744646.100501:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475295232 00000100:00100000:1.0:1788744646.100507:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475295232 00000100:00100000:1.0:1788744646.100544:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788744646.100552:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+18:5837:x1875634475295232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744646.100563:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744646.100576:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2027e6c00/0x4b162761eb39219a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb392193 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744646.100615:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2027e6c00/0x4b162761eb39219a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb392193 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744646.100625:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2027e6c00/0x4b162761eb39219a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb392193 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744646.100634:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2027e6c00, rc 0) 00000100:00100000:1.0:1788744646.100666:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:5837:x1875634475295232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744646.100673:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788744646.100705:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475295232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744646.100717:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39219a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744646.100727:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb39219a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744646.100774:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475295360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744646.100796:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744646.100808:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c9cab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744646.100818:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475295360 00000100:00100000:1.0:1788744646.100821:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475295360 00000100:00100000:1.0:1788744646.100836:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788744646.100841:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:5837:x1875634475295360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744646.101359:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:5837:x1875634475295360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 516us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744646.105258:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788744646.105369:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475295360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744646.105433:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475295488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744646.105517:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744646.105558:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c9cab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744646.105661:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475295488 00000100:00100000:0.0:1788744646.105669:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475295488 00000100:00100000:0.0:1788744646.105713:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788744646.105721:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:5837:x1875634475295488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744646.105917:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:5837:x1875634475295488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744646.105924:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788744646.105966:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:754bab6b-7807-4d58-8a45-456ed56af02a:5837:1875634475295488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744646.106193:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:11684:1875634475295616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744646.106228:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744646.106247:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475295616 00000100:00100000:0.0:1788744646.106251:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475295616 00000100:00100000:0.0:1788744646.106274:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788744646.106280:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:11684:x1875634475295616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744646.106410:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:11684:x1875634475295616:12345-0@lo:502:llog_process_th.0 Request processed in 129us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744646.106423:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788744646.106463:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23d211d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744646.106475:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:11684:1875634475295616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744646.106497:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744646.106507:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744646.106509:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788744646.106520:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93a203f6f000 00000020:00000080:0.0:1788744646.106523:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788744646.106584:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:11684:1875634475295744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744646.106610:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744646.106625:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475295744 00000100:00100000:0.0:1788744646.106629:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475295744 00000100:00100000:0.0:1788744646.106645:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788744646.106650:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:11684:x1875634475295744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744646.106734:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:11684:x1875634475295744:12345-0@lo:502:llog_process_th.0 Request processed in 83us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744646.106740:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788744646.106762:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23d211d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744646.106771:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:754bab6b-7807-4d58-8a45-456ed56af02a:11684:1875634475295744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744646.106786:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744646.106789:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744646.106791:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788744646.106795:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788744646.106835:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788744646.106854:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744646.106863:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39219a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744646.106881:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39219a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744646.112991:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788744646.124196:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744646.124299:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451142272 00000100:00100000:2.0:1788744646.124310:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451142272 00000100:00100000:2.0:1788744646.124356:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 265 00000100:00100000:2.0:1788744646.124366:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+11:5602:x1875634451142272:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744646.124383:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744646.124401:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2064f2200/0x4b162761eb3921a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e64 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744646.124433:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2064f2200/0x4b162761eb3921a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e64 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744646.124460:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2064f2200/0x4b162761eb3921a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e64 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744646.124470:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2200, rc 0) 00000100:00100000:2.0:1788744646.124527:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:5602:x1875634451142272:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 163us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744646.124533:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 265 00000100:00100000:3.0:1788744646.126326:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744646.126476:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451142400 00000100:00100000:2.0:1788744646.126486:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451142400 00000100:00100000:2.0:1788744646.126543:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 266 00000100:00100000:2.0:1788744646.126555:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:5602:x1875634451142400:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744646.126889:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:5602:x1875634451142400:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 336us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744646.126898:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 266 00000100:00100000:0.0:1788744646.142892:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744646.154401:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451142528 00000100:00100000:1.0:1788744646.154423:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451142528 00000100:00100000:1.0:1788744646.154500:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 267 00000100:00100000:1.0:1788744646.154511:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:5602:x1875634451142528:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744646.154754:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:5602:x1875634451142528:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 243us (11876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744646.154762:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 267 00000100:00100000:3.0:1788744646.158305:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744646.158352:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451142656 00000100:00100000:3.0:1788744646.158362:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451142656 00000100:00100000:3.0:1788744646.158416:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 268 00000100:00100000:3.0:1788744646.158426:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:9950:x1875634451142656:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788744646.158675:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:9950:x1875634451142656:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 249us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744646.158684:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 268 00000100:00100000:3.0:1788744646.168775:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744646.168925:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451142784 00000100:00100000:2.0:1788744646.168939:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451142784 00000100:00100000:2.0:1788744646.169006:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 269 00000100:00100000:2.0:1788744646.169018:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:9950:x1875634451142784:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744646.169433:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:9950:x1875634451142784:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 416us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744646.169442:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 269 00000100:00100000:0.0:1788744646.192109:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744646.194860:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451142912 00000100:00100000:3.0:1788744646.194880:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451142912 00000100:00100000:3.0:1788744646.195154:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 270 00000100:00100000:3.0:1788744646.195167:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:5602:x1875634451142912:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744646.195185:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744646.195207:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e81c00/0x4b162761eb3921a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e6b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744646.195239:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e81c00/0x4b162761eb3921a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e6b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744646.195250:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e81c00/0x4b162761eb3921a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e6b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744646.195260:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81c00, rc 0) 00000100:00100000:3.0:1788744646.195483:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:5602:x1875634451142912:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 318us (3401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744646.195490:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 270 00000100:00100000:2.0:1788744646.207067:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744646.207162:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451143040 00000100:00100000:3.0:1788744646.207173:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451143040 00000100:00100000:3.0:1788744646.207231:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 271 00000100:00100000:3.0:1788744646.207243:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:5602:x1875634451143040:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744646.208180:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:5602:x1875634451143040:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 932us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744646.208203:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 271 00000100:00100000:3.0:1788744646.211111:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744646.211284:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451143168 00000100:00100000:0.0:1788744646.211297:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451143168 00000100:00100000:0.0:1788744646.211369:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 272 00000100:00100000:0.0:1788744646.211391:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:5602:x1875634451143168:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744646.211647:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:5602:x1875634451143168:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 268us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744646.211655:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 272 00000100:00100000:0.0:1788744646.217026:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744646.217108:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451143296 00000100:00100000:2.0:1788744646.217120:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451143296 00000100:00100000:2.0:1788744646.217211:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 273 00000100:00100000:2.0:1788744646.217222:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:9953:x1875634451143296:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744646.217496:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:9953:x1875634451143296:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 275us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744646.217504:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 273 00000100:00100000:3.0:1788744646.223262:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744646.223365:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451143424 00000100:00100000:2.0:1788744646.223376:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451143424 00000100:00100000:2.0:1788744646.223439:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 274 00000100:00100000:2.0:1788744646.223450:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20791e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:9953:x1875634451143424:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744646.223721:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20791e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:9953:x1875634451143424:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 273us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744646.223730:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 274 00010000:00010000:1.0:1788744646.772320:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788744647.157103:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788744647.809414:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744648.822635:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744649.524749:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475296128:0@lo:400:kworker.0 00000100:00100000:2.0:1788744649.524837:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744649.524917:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475296128 00000100:00100000:2.0:1788744649.524926:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475296128 00000100:00100000:2.0:1788744649.524983:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788744649.524993:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475296128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744649.525056:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475296128:12345-0@lo:400:kworker.0 Request processed in 64us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744649.525077:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1788744649.525103:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744649.525157:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475296128:0@lo:400:kworker.0 00000100:00100000:2.0:1788744649.525189:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475295872:0@lo:400:kworker.0 00000100:00100000:0.0:1788744649.525302:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475296000:0@lo:400:kworker.0 00000100:00100000:0.0:1788744649.525331:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744649.525367:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475296000 00000100:00100000:0.0:1788744649.525371:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475296000 00000100:00100000:0.0:1788744649.525395:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788744649.525401:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475296000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744649.525434:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475296000:12345-0@lo:400:kworker.0 Request processed in 32us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744649.525439:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788744649.525466:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475296000:0@lo:400:kworker.0 00000100:00100000:0.0:1788744649.525644:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475296256:0@lo:400:kworker.0 00000100:00100000:0.0:1788744649.525677:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744649.525710:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475296256 00000100:00100000:0.0:1788744649.525714:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475296256 00000100:00100000:0.0:1788744649.525747:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788744649.525753:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475296256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744649.525788:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475296256:12345-0@lo:400:kworker.0 Request processed in 35us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744649.525794:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788744649.525810:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788744649.525828:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23cd38380 x1875634475296256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744649.525839:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475296256:0@lo:400:kworker.0 00000100:00100000:0.0:1788744649.525852:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475296512:0@lo:400:kworker.0 00000100:00100000:0.0:1788744649.525872:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744649.525891:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744649.525897:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475296384:0@lo:400:kworker.0 00000100:00100000:1.0:1788744649.525909:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475296512 00000100:00100000:1.0:1788744649.525913:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475296512 00000100:00100000:0.0:1788744649.525916:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788744649.525933:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744649.525941:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788744649.525947:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475296512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744649.525979:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744649.525987:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475296512:12345-0@lo:400:kworker.0 Request processed in 41us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744649.526009:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475296384 00000100:00100000:2.0:1788744649.526012:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475296384 00000100:00100000:2.0:1788744649.526052:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788744649.526059:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475296384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744649.526087:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475296384:12345-0@lo:400:kworker.0 Request processed in 29us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744649.526092:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1788744649.526108:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744649.526171:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475295872 00000100:00100000:2.0:1788744649.526175:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475295872 00000100:00100000:2.0:1788744649.526198:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788744649.526216:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20791e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475295872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744649.526250:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20791e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475295872:12345-0@lo:400:kworker.0 Request processed in 35us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744649.526256:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788744649.526288:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475295872:0@lo:400:kworker.0 00000100:00100000:3.0:1788744649.528967:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475296384:0@lo:400:kworker.0 00000100:00100000:3.0:1788744649.528986:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788744649.528992:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93a23d439f80, transno 4294967300 00000100:00100000:3.0:1788744649.529006:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475296512:0@lo:400:kworker.0 00000100:00100000:1.0:1788744649.532333:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:0.0:1788744649.860292:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744650.037086:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475296640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744650.037222:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744650.039163:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475296640 00000100:00100000:1.0:1788744650.039178:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475296640 00000100:00100000:1.0:1788744650.039240:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788744650.039249:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475296640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744650.039580:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744650.039716:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475296640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 410us (2436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744650.039723:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788744650.041869:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475296640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744650.149780:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744650.149902:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744650.149945:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744650.149984:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744650.150275:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451143680 00000100:00100000:0.0:1788744650.150285:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451143680 00000100:00100000:0.0:1788744650.150349:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451143936 00000100:00100000:0.0:1788744650.150352:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451143936 00000100:00100000:0.0:1788744650.150379:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 109 00000100:00100000:0.0:1788744650.150389:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2362:x1875634451143680:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744650.150480:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2362:x1875634451143680:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 91us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744650.150504:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 109 00000100:00100000:0.0:1788744650.150523:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 110 00000100:00100000:0.0:1788744650.150529:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451143936:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744650.150557:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451143936:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 28us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744650.150563:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 110 00000100:00100000:0.0:1788744650.150582:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451143808 00000100:00100000:0.0:1788744650.150585:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451143808 00000100:00100000:0.0:1788744650.150613:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:0.0:1788744650.150619:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2362:x1875634451143808:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744650.150645:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2362:x1875634451143808:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 27us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744650.150651:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:1.0:1788744650.151039:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451143552 00000100:00100000:1.0:1788744650.151045:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451143552 00000100:00100000:1.0:1788744650.151083:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 276 00000100:00100000:1.0:1788744650.151091:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20791dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2362:x1875634451143552:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744650.151179:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20791dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2362:x1875634451143552:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 89us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744650.151185:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 276 00000100:00080000:3.0:1788744650.151636:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744650.151642:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744650.548507:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475296768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744650.548594:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744650.548738:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475296768 00000100:00100000:0.0:1788744650.548747:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475296768 00000100:00100000:0.0:1788744650.548795:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788744650.548805:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475296768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744650.548839:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744650.548889:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475296768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744650.548896:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788744650.549178:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c068a80 x1875634475296768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744650.549196:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475296768:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788744650.868812:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744651.892480:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744652.924294:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744653.946973:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744654.645023:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475297152:0@lo:400:kworker.0 00000100:00100000:2.0:1788744654.645095:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744654.645306:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744654.645316:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475297280:0@lo:400:kworker.0 00000100:00100000:2.0:1788744654.645344:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744654.646898:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475297024:0@lo:400:kworker.0 00000100:00100000:1.0:1788744654.646977:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744654.647021:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475297536:0@lo:400:kworker.0 00000100:00100000:1.0:1788744654.647044:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744654.647079:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788744654.647086:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475296896:0@lo:400:kworker.0 00000100:00100000:1.0:1788744654.647112:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744654.647165:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475297408:0@lo:400:kworker.0 00000100:00100000:1.0:1788744654.647201:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744654.647242:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475297280 00000100:00100000:1.0:1788744654.647250:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475297280 00000100:00100000:1.0:1788744654.647306:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475297536 00000100:00100000:1.0:1788744654.647309:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475297536 00000100:00100000:1.0:1788744654.647333:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788744654.647357:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475297280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744654.647413:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475297280:12345-0@lo:400:kworker.0 Request processed in 57us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744654.647420:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788744654.647437:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788744654.647443:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475297536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744654.647476:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475297536:12345-0@lo:400:kworker.0 Request processed in 33us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744654.647482:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788744654.647532:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d155180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475297536:0@lo:400:kworker.0 00000100:00100000:2.0:1788744654.647796:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475296896 00000100:00100000:2.0:1788744654.647801:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475296896 00000100:00100000:2.0:1788744654.647837:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788744654.647845:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20791cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475296896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744654.647887:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20791cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475296896:12345-0@lo:400:kworker.0 Request processed in 43us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744654.647893:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00010000:00080000:2.0:1788744654.647964:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c06ea00 x1875634475297280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744654.647975:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475297280:0@lo:400:kworker.0 00000100:00100000:2.0:1788744654.647997:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475296896:0@lo:400:kworker.0 00000100:00100000:0.0:1788744654.648128:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475297152 00000100:00100000:0.0:1788744654.648172:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475297152 00000100:00100000:0.0:1788744654.648201:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475297024 00000100:00100000:0.0:1788744654.648205:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475297024 00000100:00100000:0.0:1788744654.648217:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475297408 00000100:00100000:0.0:1788744654.648219:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475297408 00000100:00100000:0.0:1788744654.648233:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788744654.648240:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475297152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744654.648284:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475297152:12345-0@lo:400:kworker.0 Request processed in 45us (3188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744654.648291:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788744654.648298:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788744654.648302:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788744654.648307:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475297024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744654.648320:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475297408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744654.648346:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475297024:12345-0@lo:400:kworker.0 Request processed in 41us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744654.648346:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475297408:12345-0@lo:400:kworker.0 Request processed in 26us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744654.648352:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788744654.648741:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475297408:0@lo:400:kworker.0 00000100:00100000:2.0:1788744654.648753:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475297024:0@lo:400:kworker.0 00000100:00080000:2.0:1788744654.648781:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744654.648791:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744654.648793:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744654.649022:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475297152:0@lo:400:kworker.0 00000100:00100000:0.0:1788744654.654058:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00010000:1.0:1788744654.964332:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744655.158922:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475297664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744655.159230:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744655.159387:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475297664 00000100:00100000:1.0:1788744655.159397:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475297664 00000100:00100000:1.0:1788744655.159457:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788744655.159468:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475297664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744655.159747:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744655.159798:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475297664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 332us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744655.159805:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788744655.160649:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475297664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744655.269677:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744655.269713:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744655.269737:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744655.269768:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744655.269814:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451144192 00000100:00100000:3.0:1788744655.269824:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451144192 00000100:00100000:3.0:1788744655.269882:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451144448 00000100:00100000:3.0:1788744655.269886:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451144448 00000100:00100000:3.0:1788744655.269911:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 114 00000100:00100000:3.0:1788744655.269931:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2361:x1875634451144192:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744655.270014:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2361:x1875634451144192:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 93us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744655.270021:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 114 00000100:00100000:3.0:1788744655.270039:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:3.0:1788744655.270045:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2361:x1875634451144448:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744655.270071:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2361:x1875634451144448:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 27us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744655.270077:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00080000:3.0:1788744655.270093:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744655.270229:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451144320 00000100:00100000:1.0:1788744655.270234:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451144320 00000100:00100000:1.0:1788744655.270272:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:1.0:1788744655.270278:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2361:x1875634451144320:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744655.270311:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2361:x1875634451144320:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 35us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744655.270316:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00080000:1.0:1788744655.270339:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744655.270454:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451144064 00000100:00100000:2.0:1788744655.270458:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451144064 00000100:00100000:2.0:1788744655.270483:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 278 00000100:00100000:2.0:1788744655.270487:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2361:x1875634451144064:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744655.270507:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2361:x1875634451144064:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 21us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744655.270511:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 278 00000100:00100000:2.0:1788744655.668469:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744655.668496:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475297792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744655.668584:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744655.672419:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475297792 00000100:00100000:3.0:1788744655.672435:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475297792 00000100:00100000:3.0:1788744655.672491:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788744655.672500:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475297792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744655.672534:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744655.672619:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475297792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (4036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744655.672627:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788744655.675280:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23d155f80 x1875634475297792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744655.675327:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475297792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788744655.988364:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744657.012250:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744657.397087:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788744658.039917:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744659.060488:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744659.768478:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475297920:0@lo:400:kworker.0 00000100:00100000:0.0:1788744659.768526:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475298176:0@lo:400:kworker.0 00000100:00100000:3.0:1788744659.771717:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475298304:0@lo:400:kworker.0 00000100:00100000:1.0:1788744659.772652:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475298048:0@lo:400:kworker.0 00000100:00100000:0.0:1788744659.778237:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744659.778387:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475298176 00000100:00100000:0.0:1788744659.778397:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475298176 00000100:00100000:0.0:1788744659.778468:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788744659.778479:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475298176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744659.778545:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475298176:12345-0@lo:400:kworker.0 Request processed in 69us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744659.778552:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1788744659.778572:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744659.778602:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475298176:0@lo:400:kworker.0 00000100:00100000:2.0:1788744659.785551:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744659.785644:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475298432:0@lo:400:kworker.0 00000100:00100000:2.0:1788744659.785707:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744659.785740:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475298432 00000100:00100000:2.0:1788744659.785749:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475298432 00000100:00100000:2.0:1788744659.785805:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788744659.785814:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475298432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744659.785877:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475298432:12345-0@lo:400:kworker.0 Request processed in 65us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744659.785898:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1788744659.785925:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744659.785954:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475298432:0@lo:400:kworker.0 00000100:00100000:0.0:1788744659.787454:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475297920 00000100:00100000:0.0:1788744659.787478:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475297920 00000100:00100000:0.0:1788744659.787539:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788744659.787549:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475297920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744659.787637:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475297920:12345-0@lo:400:kworker.0 Request processed in 90us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744659.787643:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788744659.787732:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475297920:0@lo:400:kworker.0 00000100:00100000:3.0:1788744659.792874:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744659.797553:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475298304 00000100:00100000:2.0:1788744659.797568:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475298304 00000100:00100000:2.0:1788744659.797661:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788744659.797672:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475298304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744659.797759:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475298304:12345-0@lo:400:kworker.0 Request processed in 89us (4894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744659.797766:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788744659.798116:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788744659.798186:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c9b0700 x1875634475298304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744659.798201:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475298304:0@lo:400:kworker.0 00000100:00100000:1.0:1788744659.800561:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744659.800608:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475298560:0@lo:400:kworker.0 00000100:00100000:1.0:1788744659.800678:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744659.800732:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475298560 00000100:00100000:1.0:1788744659.800741:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475298560 00000100:00100000:1.0:1788744659.800812:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788744659.800823:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475298560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744659.800874:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475298048 00000100:00100000:0.0:1788744659.800881:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475298048 00000100:00100000:1.0:1788744659.800895:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475298560:12345-0@lo:400:kworker.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744659.800903:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788744659.800918:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788744659.800938:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475298048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744659.800955:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475298560:0@lo:400:kworker.0 00000100:00100000:1.0:1788744659.800989:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475298048:0@lo:400:kworker.0 00000100:00080000:3.0:1788744659.801017:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744659.801331:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475298048:12345-0@lo:400:kworker.0 Request processed in 405us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744659.801338:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00010000:0.0:1788744660.084777:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744660.279677:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475298688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744660.279757:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744660.281532:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475298688 00000100:00100000:1.0:1788744660.281546:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475298688 00000100:00100000:1.0:1788744660.281613:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788744660.281623:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475298688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744660.281660:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744660.281745:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475298688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744660.281751:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788744660.282524:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475298688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744660.393756:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744660.393800:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744660.393944:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451144576 00000100:00100000:2.0:1788744660.393955:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451144576 00000100:00100000:3.0:1788744660.393987:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451144704 00000100:00100000:3.0:1788744660.393995:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451144704 00000100:00100000:2.0:1788744660.394030:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 280 00000100:00100000:2.0:1788744660.394042:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2361:x1875634451144576:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744660.394073:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 119 00000100:00100000:3.0:1788744660.394095:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2361:x1875634451144704:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744660.394119:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2361:x1875634451144576:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 77us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744660.394127:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 280 00000100:00100000:3.0:1788744660.394171:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2361:x1875634451144704:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 90us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744660.394180:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 119 00000100:00080000:1.0:1788744660.394373:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744660.409818:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744660.409876:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744660.409968:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451144960 00000100:00100000:1.0:1788744660.409978:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451144960 00000100:00100000:1.0:1788744660.410055:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:1.0:1788744660.410063:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451144960:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744660.410124:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451144960:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 63us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744660.410153:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:2.0:1788744660.410162:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451144832 00000100:00100000:2.0:1788744660.410168:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451144832 00000100:00100000:2.0:1788744660.410221:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:2.0:1788744660.410231:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2358:x1875634451144832:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:2.0:1788744660.410256:0:6684:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb3920e4 00000100:00080000:2.0:1788744660.410268:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93a23cd67000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788744660.410313:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788744660.410571:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+2:2358:x1875634451144832:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 342us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744660.410579:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00010000:00010000:0.0:1788744660.410663:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788744660.410854:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744660.410859:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744660.791457:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475298816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744660.791612:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744660.791735:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475298816 00000100:00100000:1.0:1788744660.791745:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475298816 00000100:00100000:1.0:1788744660.791813:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788744660.791824:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475298816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744660.791893:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744660.801024:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475298816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9180us (9397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744660.801041:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788744660.801747:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23d156680 x1875634475298816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744660.801775:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475298816:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788744661.110939:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744662.135399:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744663.159250:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744664.180434:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744664.885030:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475298944:0@lo:400:kworker.0 00000100:00100000:0.0:1788744664.885121:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744664.885153:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475299072:0@lo:400:kworker.0 00000100:00100000:1.0:1788744664.885196:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744664.885329:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744664.885336:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475299456:0@lo:400:kworker.0 00000100:00100000:1.0:1788744664.885362:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744664.885427:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475299328:0@lo:400:kworker.0 00000100:00100000:3.0:1788744664.885459:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744664.885480:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744664.885485:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634475299200:0@lo:400:kworker.0 00000100:00100000:3.0:1788744664.885503:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744664.885507:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475298944 00000100:00100000:0.0:1788744664.885518:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475298944 00000100:00100000:1.0:1788744664.885572:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475299072 00000100:00100000:0.0:1788744664.885575:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788744664.885578:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475299072 00000100:00100000:0.0:1788744664.885588:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475298944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744664.885611:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475299456 00000100:00100000:1.0:1788744664.885615:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475299456 00000100:00100000:1.0:1788744664.885651:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475299200 00000100:00100000:1.0:1788744664.885654:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475299200 00000100:00100000:1.0:1788744664.885670:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788744664.885676:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475299072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744664.885729:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475299072:12345-0@lo:400:kworker.0 Request processed in 53us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744664.885785:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475298944:12345-0@lo:400:kworker.0 Request processed in 199us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744664.885792:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788744664.885941:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788744664.885963:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788744664.885970:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475299456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744664.886019:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475299456:12345-0@lo:400:kworker.0 Request processed in 49us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744664.886026:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788744664.886043:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788744664.886051:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634475299200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744664.886083:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634475299200:12345-0@lo:400:kworker.0 Request processed in 33us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744664.886090:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788744664.886122:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475299328 00000100:00100000:1.0:1788744664.886126:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475299328 00000100:00100000:1.0:1788744664.886185:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788744664.886191:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475299328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744664.886224:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475299328:12345-0@lo:400:kworker.0 Request processed in 34us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744664.886230:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788744664.886249:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744664.886254:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744664.886269:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475299584:0@lo:400:kworker.0 00000100:00100000:1.0:1788744664.886303:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744664.886343:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475299456:0@lo:400:kworker.0 00000100:00100000:1.0:1788744664.886368:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475299072:0@lo:400:kworker.0 00000100:00100000:0.0:1788744664.886388:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475298944:0@lo:400:kworker.0 00000100:00100000:1.0:1788744664.886409:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475299584 00000100:00100000:1.0:1788744664.886414:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475299584 00000100:00100000:1.0:1788744664.886445:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788744664.886451:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475299584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744664.886484:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475299584:12345-0@lo:400:kworker.0 Request processed in 33us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744664.886490:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788744664.886519:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744664.886536:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475299584:0@lo:400:kworker.0 00000100:00100000:3.0:1788744664.895539:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634475299200:0@lo:400:kworker.0 00010000:00080000:3.0:1788744664.895558:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a220a54a80 x1875634475299328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744664.895568:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475299328:0@lo:400:kworker.0 00010000:00010000:0.0:1788744665.208178:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744665.397362:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744665.397385:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475299712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744665.397452:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744665.397700:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475299712 00000100:00100000:1.0:1788744665.397708:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475299712 00000100:00100000:1.0:1788744665.397772:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788744665.397782:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475299712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744665.397831:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744665.397892:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475299712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744665.397900:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788744665.397989:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475299712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744665.515482:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744665.515520:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744665.515556:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744665.515617:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451145344 00000100:00100000:3.0:1788744665.515628:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451145344 00000100:00100000:3.0:1788744665.515687:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451145216 00000100:00100000:3.0:1788744665.515690:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451145216 00000100:00100000:3.0:1788744665.515715:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 124 00000100:00100000:3.0:1788744665.515725:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451145344:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744665.515806:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451145344:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 83us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744665.515813:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 124 00000100:00100000:3.0:1788744665.515832:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 125 00000100:00100000:3.0:1788744665.515838:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2359:x1875634451145216:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744665.515865:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2359:x1875634451145216:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 27us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744665.515872:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 125 00000100:00080000:2.0:1788744665.516152:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744665.516248:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451145088 00000100:00100000:1.0:1788744665.516253:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451145088 00000100:00100000:1.0:1788744665.516294:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 282 00000100:00100000:1.0:1788744665.516301:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2359:x1875634451145088:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744665.516363:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2359:x1875634451145088:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 62us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744665.516369:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 282 00000001:00100000:3.0:1788744665.540063:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 390441fa-c0e0-4bda-b106-b1a75da212d8 00000020:00000080:3.0:1788744665.540074:0:7638:0:(genops.c:885:class_export_put()) final put ffff93a23cd66000/390441fa-c0e0-4bda-b106-b1a75da212d8 00000020:00000080:1.0:1788744665.540228:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23cd66000/390441fa-c0e0-4bda-b106-b1a75da212d8 for lustre-OST0001 00000020:00000080:1.0:1788744665.540287:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a23cd67000 for lustre-OST0001 00000100:00100000:0.0:1788744665.915156:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744665.915182:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475299840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744665.917407:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744665.917488:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475299840 00000100:00100000:0.0:1788744665.917498:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475299840 00000100:00100000:0.0:1788744665.917549:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788744665.917560:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475299840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744665.917600:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744665.917657:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475299840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744665.917674:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1788744665.917726:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c9b3100 x1875634475299840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744665.917756:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475299840:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788744666.235082:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744667.256016:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744667.640411:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788744668.277063:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744669.300522:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788744669.824015:0:11849:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:31:07 (1788744667) 00000100:00100000:2.0:1788744670.005522:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475300224:0@lo:400:kworker.0 00000100:00100000:2.0:1788744670.005600:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744670.005655:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744670.005661:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475300352:0@lo:400:kworker.0 00000100:00100000:2.0:1788744670.005704:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744670.005743:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475300352 00000100:00100000:2.0:1788744670.005751:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475300352 00000100:00100000:2.0:1788744670.005802:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788744670.005811:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475300352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744670.005859:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475300352:12345-0@lo:400:kworker.0 Request processed in 49us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744670.005865:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788744670.005894:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788744670.005939:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23d156300 x1875634475300352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744670.005954:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475300352:0@lo:400:kworker.0 00000100:00100000:3.0:1788744670.007575:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475299968:0@lo:400:kworker.0 00000100:00100000:3.0:1788744670.007656:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744670.007716:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475300480:0@lo:400:kworker.0 00000100:00100000:3.0:1788744670.007742:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744670.007769:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788744670.007775:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475300096:0@lo:400:kworker.0 00000100:00100000:3.0:1788744670.007793:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744670.007810:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475300608:0@lo:400:kworker.0 00000100:00100000:3.0:1788744670.007834:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744670.007870:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475300224 00000100:00100000:3.0:1788744670.007877:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475300224 00000100:00100000:3.0:1788744670.007928:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475300480 00000100:00100000:3.0:1788744670.007932:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475300480 00000100:00100000:3.0:1788744670.007944:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475300096 00000100:00100000:3.0:1788744670.007946:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475300096 00000100:00100000:3.0:1788744670.007961:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788744670.007968:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475300224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744670.008020:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475300224:12345-0@lo:400:kworker.0 Request processed in 53us (2421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744670.008026:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788744670.008043:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788744670.008049:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475300480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744670.008079:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475300480:12345-0@lo:400:kworker.0 Request processed in 31us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744670.008085:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788744670.008096:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788744670.008102:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475300096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744670.008181:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475300096:12345-0@lo:400:kworker.0 Request processed in 80us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744670.008188:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788744670.008209:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475299968 00000100:00100000:3.0:1788744670.008212:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475299968 00000100:00100000:3.0:1788744670.008238:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788744670.008244:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475299968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744670.008271:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475299968:12345-0@lo:400:kworker.0 Request processed in 29us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744670.008277:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788744670.008311:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475300608 00000100:00100000:3.0:1788744670.008315:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475300608 00000100:00100000:3.0:1788744670.008342:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788744670.008349:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475300608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744670.008377:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475300608:12345-0@lo:400:kworker.0 Request processed in 28us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744670.008382:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1788744670.008406:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744670.008410:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744670.008434:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475300096:0@lo:400:kworker.0 00000100:00100000:3.0:1788744670.008445:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475300608:0@lo:400:kworker.0 00000100:00100000:3.0:1788744670.008452:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475299968:0@lo:400:kworker.0 00000100:00100000:3.0:1788744670.008460:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475300480:0@lo:400:kworker.0 00000100:00100000:3.0:1788744670.008494:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475300224:0@lo:400:kworker.0 00010000:00010000:1.0:1788744670.324524:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744670.516490:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475300736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744670.516563:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744670.517204:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475300736 00000100:00100000:1.0:1788744670.517215:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475300736 00000100:00100000:1.0:1788744670.517272:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788744670.517292:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475300736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744670.517331:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744670.517406:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475300736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744670.517413:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788744670.518222:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475300736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744670.630239:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744670.630390:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451145600 00000100:00100000:3.0:1788744670.630402:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451145600 00000100:00100000:3.0:1788744670.630493:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 129 00000100:00100000:3.0:1788744670.630505:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2359:x1875634451145600:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744670.630597:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2359:x1875634451145600:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 94us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744670.630605:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 129 00000100:00080000:2.0:1788744670.630842:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744670.636515:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744670.636619:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451145472 00000100:00100000:2.0:1788744670.636628:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451145472 00000100:00100000:2.0:1788744670.636741:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 284 00000100:00100000:2.0:1788744670.636751:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2360:x1875634451145472:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744670.636827:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2360:x1875634451145472:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 78us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744670.636834:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 284 00000100:00100000:0.0:1788744670.647962:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744670.652447:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451145728 00000100:00100000:3.0:1788744670.652463:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451145728 00000100:00100000:3.0:1788744670.652604:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 130 00000100:00100000:3.0:1788744670.652614:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451145728:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744670.652901:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451145728:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 287us (5067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744670.653557:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 130 00000100:00080000:2.0:1788744670.661225:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744671.029195:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475300864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744671.029271:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744671.031977:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475300864 00000100:00100000:0.0:1788744671.031997:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475300864 00000100:00100000:0.0:1788744671.032087:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788744671.032097:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475300864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744671.032164:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744671.032249:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475300864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744671.032257:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788744671.032411:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23c9b2a00 x1875634475300864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744671.032431:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475300864:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788744671.348379:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744671.713304:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744671.713455:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451145856 00000100:00100000:3.0:1788744671.713464:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451145856 00000100:00100000:3.0:1788744671.713523:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:3.0:1788744671.713534:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:10223:x1875634451145856:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744671.713559:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744671.713585:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3921af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e72 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744671.713953:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3921b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744671.717049:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3921b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744671.717081:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3921b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744671.717164:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788744671.717170:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744671.717228:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3921b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744671.717264:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3921af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e72 expref: 7 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744671.717290:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3921b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e72 expref: 6 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744671.717299:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744671.717302:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744671.717306:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81800, rc 0) 00000100:00100000:3.0:1788744671.717401:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+6:10223:x1875634451145856:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 3867us (4107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744671.717411:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:0.0:1788744671.730927:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744671.731038:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451145984 00000100:00100000:3.0:1788744671.731051:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451145984 00000100:00100000:3.0:1788744671.731121:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:3.0:1788744671.731308:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:10224:x1875634451145984:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744671.731332:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744671.731377:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3921bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744671.731458:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3921c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744671.731474:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3921c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744671.731489:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3921c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744671.731505:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3921cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744671.731513:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3921cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744671.731521:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3921cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744671.731762:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb3921d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744671.731772:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb3921d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744671.731779:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb3921d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744671.731808:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788744671.731813:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744671.735073:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb3921d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735102:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3921c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735115:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3921c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735160:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3921c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735168:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744671.735172:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3921c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735181:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3921c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735227:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:2.0:1788744671.735230:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744671.735236:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3921c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735243:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3921c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735267:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3921cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735274:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3921cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735280:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3921cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735285:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744671.735288:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3921cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735295:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3921cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735303:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93a21a9ae700) 00010000:00010000:2.0:1788744671.735305:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744671.735308:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3921cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735314:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3921cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735375:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3921bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e79 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735391:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb3921d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e79 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744671.735399:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93a21a9ae600) 00010000:00010000:2.0:1788744671.735402:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744671.735404:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81200, rc 0) 00000100:00100000:2.0:1788744671.735489:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+7:10224:x1875634451145984:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 4186us (4574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744671.735498:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:0.0:1788744671.744252:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744671.744402:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451146240 00000100:00100000:1.0:1788744671.744413:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451146240 00000100:00100000:1.0:1788744671.744471:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:1.0:1788744671.744481:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+7:10224:x1875634451146240:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744671.744506:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744671.744526:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb3921d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e80 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.744601:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb3921e0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.744617:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb3921e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.744628:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb3921e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.744720:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3921e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.744728:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3921e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.744734:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3921e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.745538:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7800/0x4b162761eb3921ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.745553:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7800/0x4b162761eb3921ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.745562:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7800/0x4b162761eb3921ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744671.745574:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788744671.745771:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb3921e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.745780:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb3921e0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.745786:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb3921e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.745793:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e7400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744671.745798:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb3921e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.745828:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb3921e0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.745843:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93a21a9ae600) 00010000:00010000:1.0:1788744671.745846:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744671.745852:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb3921e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.745859:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb3921e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.745872:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3921e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.751104:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3921e7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.751116:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3921e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.751149:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e7200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744671.751154:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3921e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.751165:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3921e7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.751184:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93a203446800) 00010000:00010000:1.0:1788744671.751187:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744671.751191:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3921e7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.751231:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3921e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.755814:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb3921d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e80 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.755858:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7800/0x4b162761eb3921ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e80 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744671.755868:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93a203446f00) 00010000:00010000:1.0:1788744671.755871:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744671.755875:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2027e7800, rc 0) 00000100:00100000:1.0:1788744671.760463:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+9:10224:x1875634451146240:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 15970us (16209us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788744671.760477:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:0.0:1788744671.766934:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744671.766993:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451146368 00000100:00100000:1.0:1788744671.767005:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451146368 00000100:00100000:1.0:1788744671.767066:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:1.0:1788744671.767075:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+9:10224:x1875634451146368:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788744671.767372:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+9:10224:x1875634451146368:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 Request processed in 294us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744671.767381:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00010000:00010000:0.0:1788744672.378939:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744672.757442:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788744673.397451:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744673.909637:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744673.909767:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451146496 00000100:00100000:3.0:1788744673.909792:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451146496 00000100:00100000:3.0:1788744673.909873:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:3.0:1788744673.909886:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+9:10266:x1875634451146496:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788744673.909907:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744673.909930:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3921fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e87 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.909999:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392203 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910015:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392203 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910028:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392203 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910043:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb39220a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910050:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb39220a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910055:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb39220a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910273:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392203 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910281:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392203 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910289:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392203 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910301:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744673.910305:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392203 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910312:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392203 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910325:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744673.910327:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744673.910332:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392203 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910338:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392203 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910352:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb39220a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910357:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb39220a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910362:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb39220a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910367:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744673.910370:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb39220a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910376:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb39220a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910393:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93a21a9ae100) 00010000:00010000:3.0:1788744673.910396:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744673.910399:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb39220a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910404:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb39220a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910438:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3921fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e87 expref: 10 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910448:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744673.910450:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744673.910454:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3921fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e87 expref: 10 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.910463:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80c00, rc 0) 00000100:00100000:3.0:1788744673.910524:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+9:10266:x1875634451146496:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 640us (898us total) trans 0 rc 301/301 00000100:00100000:3.0:1788744673.910532:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00080000:0.0:1788744673.911067:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744673.914072:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744673.914165:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451146752 00000100:00100000:3.0:1788744673.914176:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451146752 00000100:00100000:3.0:1788744673.914230:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:3.0:1788744673.914241:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+9:10266:x1875634451146752:12345-192.168.201.6@tcp:36:lfs.0 00010000:00010000:3.0:1788744673.914299:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744673.914328:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3921b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e72 expref: 9 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.914368:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744673.914381:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744673.914621:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392211 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.914635:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392211 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.914646:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392211 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.914658:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392218 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.914666:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392218 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.914673:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392218 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744673.915558:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788744673.915570:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392211 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.915578:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392211 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.915585:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392211 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.915592:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201472e00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744673.915622:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392211 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.915631:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392211 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.915643:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae400) 00010000:00010000:3.0:1788744673.915646:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744673.915651:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392211 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.915657:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392211 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744673.915678:0:5840:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000009fe979 reply state 00000000ad367c2b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392218 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744673.915688:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744673.915800:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+10:10266:x1875634451146752:12345-192.168.201.6@tcp:36:lfs.0 Request processed in 1559us (1736us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788744673.915809:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00010000:00010000:0.0:1788744673.920306:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392218 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744673.920324:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392218 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744673.920332:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392218 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744673.920338:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201473000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744673.920342:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392218 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744673.920350:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392218 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744673.920366:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93a21a9aee00) 00010000:00010000:0.0:1788744673.920369:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744673.920373:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392218 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744673.920379:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392218 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744673.985033:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744673.985114:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451146880 00000100:00100000:3.0:1788744673.985125:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451146880 00000100:00100000:3.0:1788744673.985208:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:3.0:1788744673.985218:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+9:10274:x1875634451146880:12345-192.168.201.6@tcp:101:lctl.0 00010000:00010000:3.0:1788744673.985244:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744673.985271:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb39221f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e8e expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.985340:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472200/0x4b162761eb392226 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.985422:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472200/0x4b162761eb392226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.985435:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472200/0x4b162761eb392226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744673.985471:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788744673.985474:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744673.985512:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472200/0x4b162761eb392226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.985536:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb39221f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e8e expref: 11 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.985555:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472200/0x4b162761eb392226 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e8e expref: 10 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744673.985564:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae400) 00010000:00010000:3.0:1788744673.985567:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744673.985571:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a201472200, rc 0) 00000100:00100000:3.0:1788744673.985637:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+10:10274:x1875634451146880:12345-192.168.201.6@tcp:101:lctl.0 Request processed in 421us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744673.985644:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:3.0:1788744674.047455:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744674.047613:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451147008 00000100:00100000:0.0:1788744674.047624:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451147008 00000100:00100000:0.0:1788744674.047697:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:0.0:1788744674.047717:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+10:10280:x1875634451147008:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1788744674.047736:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744674.047756:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39222d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.047831:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392234 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.047843:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392234 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.047860:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392234 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.047870:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39223b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.047875:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39223b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.047879:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39223b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.047954:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f800/0x4b162761eb392242 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.047958:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f800/0x4b162761eb392242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.047962:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f800/0x4b162761eb392242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744674.047993:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788744674.047996:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744674.048024:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f800/0x4b162761eb392242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048033:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392234 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048037:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392234 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048042:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392234 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048045:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ee00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744674.048048:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392234 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048053:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392234 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048061:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae400) 00010000:00010000:0.0:1788744674.048063:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744674.048066:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392234 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048070:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392234 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048078:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39223b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048098:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39223b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048102:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39223b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048105:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744674.048107:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39223b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048111:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39223b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048115:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93a203c30900) 00010000:00010000:0.0:1788744674.048117:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744674.048118:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39223b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048121:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39223b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048181:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39222d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e95 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048205:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f800/0x4b162761eb392242 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e95 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.048213:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:0.0:1788744674.048215:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788744674.048223:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17f800, rc 0) 00000100:00100000:0.0:1788744674.048281:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+11:10280:x1875634451147008:12345-192.168.201.6@tcp:101:bash.0 Request processed in 564us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744674.048286:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:1.0:1788744674.051725:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744674.051794:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451147264 00000100:00100000:3.0:1788744674.051804:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451147264 00000100:00100000:3.0:1788744674.051864:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:3.0:1788744674.051872:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+11:10280:x1875634451147264:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788744674.051902:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744674.051919:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392249 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54e9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.052023:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392250 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.052034:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392250 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.052042:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392250 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.052550:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392257 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.052560:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392257 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.052568:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392257 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788744674.053045:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788744674.053749:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39225e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.053763:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39225e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.053773:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39225e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.053866:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392250 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.053871:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392250 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.053947:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392250 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.053955:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201473000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744674.053959:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392250 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.053968:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392250 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.053981:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:3.0:1788744674.053984:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744674.053990:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392250 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.053996:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392250 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744674.054011:0:5841:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000006500d59b reply state 000000004aa5567e transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392257 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744674.054020:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788744674.054056:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392249 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e9c expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.054371:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39225e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e9c expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.054381:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae100) 00010000:00010000:3.0:1788744674.054384:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744674.054387:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80c00, rc 0) 00000100:00100000:3.0:1788744674.054592:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+14:10280:x1875634451147264:12345-192.168.201.6@tcp:101:bash.0 Request processed in 2718us (2873us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788744674.054609:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 40 00010000:00010000:1.0:1788744674.055964:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392257 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.055980:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392257 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.056006:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392257 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.056012:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744674.056017:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392257 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.056025:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392257 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.056040:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a21a9ae800) 00010000:00010000:1.0:1788744674.056044:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744674.056049:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392257 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.056055:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392257 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744674.061279:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744674.062372:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451147392 00000100:00100000:2.0:1788744674.062387:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451147392 00000100:00100000:2.0:1788744674.062628:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:2.0:1788744674.062637:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1875634451147392:12345-192.168.201.6@tcp:8:bash.0 00010000:00080000:2.0:1788744674.062669:0:9032:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp t0 exp 0000000000000000 cur 376 last 0 00000020:00000080:2.0:1788744674.062703:0:9032:0:(genops.c:1384:class_connect()) connect: client 390441fa-c0e0-4bda-b106-b1a75da212d8, cookie 0x4b162761eb39226c 00002000:00100000:2.0:1788744674.062716:0:9032:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 390441fa-c0e0-4bda-b106-b1a75da212d8/ffff93a205cd1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788744674.062742:0:9032:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:2.0:1788744674.062996:0:9032:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788744674.063029:0:9032:0:(import.c:65:import_set_state_nolock()) ffff93a205cd2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744674.063116:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2358:x1875634451147392:12345-192.168.201.6@tcp:8:bash.0 Request processed in 478us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744674.063124:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:3.0:1788744674.065024:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744674.065251:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451147520 00000100:00100000:1.0:1788744674.065262:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451147520 00000100:00100000:1.0:1788744674.065332:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:1.0:1788744674.065343:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:0:x1875634451147520:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1788744674.065362:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744674.065387:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb392273 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54ea3 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744674.065426:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744674.065457:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1788744674.065474:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744674.065483:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb392273 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ea3 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.065504:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb392273 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ea3 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.065518:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2027e7e00, rc 0) 00000100:00100000:1.0:1788744674.065578:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+7:0:x1875634451147520:12345-192.168.201.6@tcp:101:bash.0 Request processed in 237us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744674.065585:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00080000:0.0:1788744674.065878:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744674.069290:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744674.069488:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451147648 00000100:00100000:1.0:1788744674.069498:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451147648 00000100:00100000:1.0:1788744674.069556:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:1.0:1788744674.069567:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+7:10280:x1875634451147648:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1788744674.069588:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744674.069619:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54eaa expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.069656:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb392273 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ea3 expref: 8 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.069666:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744674.069680:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744674.069686:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eaa expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.069747:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb392273 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ea3 expref: 8 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.069763:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb392273 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ea3 expref: 8 pid: 6684 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744674.069778:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd9df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1875634475300992:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744674.069890:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2204bd240 going to sleep for 11 seconds 00000100:00100000:1.0:1788744674.072760:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd9df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1875634475300992:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744674.072798:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eaa expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.072820:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2027e6000, rc 0) 00000100:00100000:1.0:1788744674.072931:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+8:10280:x1875634451147648:12345-192.168.201.6@tcp:101:bash.0 Request processed in 3364us (3651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744674.072940:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:0.0:1788744674.086338:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744674.086441:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451147776 00000100:00100000:2.0:1788744674.086461:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451147776 00010000:00010000:2.0:1788744674.086502:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb392273 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ea3 expref: 8 pid: 6684 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744674.086544:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:2.0:1788744674.086554:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2360:x1875634451147776:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744674.086569:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744674.086591:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb392273 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ea3 expref: 8 pid: 6684 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.086614:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb392273 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ea3 expref: 8 pid: 6684 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.086640:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb392273 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ea3 expref: 8 pid: 6684 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.086659:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744674.086663:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744674.086671:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eaa expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.086681:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eaa expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.086718:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eaa expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744674.086747:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d155880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1875634475301120:192.168.201.6@tcp:105: 00000100:00100000:2.0:1788744674.086838:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c40bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744674.089022:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d155880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1875634475301120:192.168.201.6@tcp:105: 00010000:00010000:2.0:1788744674.089052:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744674.089105:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2360:x1875634451147776:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 2551us (2777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744674.089117:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:1.0:1788744674.090519:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744674.090571:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451148032 00000100:00100000:2.0:1788744674.090582:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451148032 00000100:00100000:2.0:1788744674.090727:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:2.0:1788744674.090738:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+13:10280:x1875634451148032:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:2.0:1788744674.091758:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+14:10280:x1875634451148032:12345-192.168.201.6@tcp:35:bash.0 Request processed in 1016us (1239us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788744674.091769:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:0.0:1788744674.185437:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744674.185545:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451148288 00000100:00100000:2.0:1788744674.185558:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451148288 00000100:00100000:2.0:1788744674.185652:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:2.0:1788744674.185663:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+14:10290:x1875634451148288:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744674.185693:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744674.185717:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb392281 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54eb1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744674.185813:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788744674.185936:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb392281 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eb1 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.185964:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae400) 00010000:00010000:2.0:1788744674.185968:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744674.185973:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb392281 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eb1 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.185988:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3e00, rc 0) 00000100:00100000:2.0:1788744674.186058:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+15:10290:x1875634451148288:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 396us (631us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788744674.186066:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:2.0:1788744674.189435:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744674.189590:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451148544 00000100:00100000:3.0:1788744674.189613:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451148544 00000100:00100000:3.0:1788744674.189677:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1788744674.189688:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+15:10290:x1875634451148544:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1788744674.189955:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+16:10290:x1875634451148544:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 269us (530us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788744674.189962:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1788744674.259242:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744674.259454:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451148672 00000100:00100000:0.0:1788744674.259465:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451148672 00000100:00100000:0.0:1788744674.259538:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:0.0:1788744674.259549:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+16:10296:x1875634451148672:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788744674.259575:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744674.259612:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39228f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54eb8 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.259684:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392296 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.259700:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.259713:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744674.259752:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788744674.259756:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744674.259780:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.259826:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39228f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eb8 expref: 18 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.259857:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eb8 expref: 17 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.259866:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:0.0:1788744674.259869:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744674.259873:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17e400, rc 0) 00000100:00100000:0.0:1788744674.259938:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+17:10296:x1875634451148672:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 391us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744674.259945:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:0.0:1788744674.264600:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744674.264686:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451148928 00000100:00100000:2.0:1788744674.264698:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451148928 00000100:00100000:2.0:1788744674.264763:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:2.0:1788744674.264774:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+17:10296:x1875634451148928:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744674.264804:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744674.264825:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39229d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54ebf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.264941:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb3922a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.264956:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb3922a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.264967:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb3922a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744674.264997:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788744674.265170:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39229d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ebf expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.265189:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb3922a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ebf expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.265198:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae100) 00010000:00010000:2.0:1788744674.265200:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744674.265203:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3c00, rc 0) 00000100:00100000:2.0:1788744674.265258:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+19:10296:x1875634451148928:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 486us (676us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788744674.265265:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:2.0:1788744674.269072:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744674.269182:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451149184 00000100:00100000:0.0:1788744674.269196:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451149184 00000100:00100000:0.0:1788744674.269261:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:0.0:1788744674.269272:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+19:10296:x1875634451149184:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788744674.269299:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744674.269449:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3922b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54ec6 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.269555:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3922b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.269570:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3922b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.269583:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3922b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744674.269624:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788744674.269963:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3922b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ec6 expref: 22 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.269983:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3922b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ec6 expref: 21 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.269991:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae100) 00010000:00010000:0.0:1788744674.269994:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788744674.269997:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17f200, rc 0) 00000100:00100000:0.0:1788744674.270106:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+21:10296:x1875634451149184:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 834us (1049us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788744674.270114:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:1.0:1788744674.279077:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744674.279553:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451149312 00000100:00100000:3.0:1788744674.279563:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451149312 00000100:00100000:3.0:1788744674.279642:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:3.0:1788744674.279653:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+21:2360:x1875634451149312:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744674.279669:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744674.279693:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb3922a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ebf expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.279732:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae100) 00010000:00010000:3.0:1788744674.279737:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744674.279798:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+20:2360:x1875634451149312:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 147us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744674.279805:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:3.0:1788744674.286117:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744674.286627:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451149440 00000100:00100000:1.0:1788744674.286638:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451149440 00000100:00100000:1.0:1788744674.286735:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:1.0:1788744674.286746:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2359:x1875634451149440:12345-192.168.201.6@tcp:1:lfs.0 00010000:00010000:1.0:1788744674.286809:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb3922c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.286851:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eaa expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.286861:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744674.286865:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744674.286870:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb3922c7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.286912:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eaa expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.286927:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eaa expref: 7 pid: 6685 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744674.286942:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1875634475301248:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744674.287054:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2204bd240 going to sleep for 11 seconds 00000100:00100000:2.0:1788744674.290692:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744674.290833:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd9e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1875634475301248:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744674.290876:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb3922c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744674.291116:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451149568 00000100:00100000:3.0:1788744674.291256:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451149568 00002000:00100000:3.0:1788744674.291303:0:6688:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff93a23d155c00 x1875634451149568/t0(0) o4->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:195/0 lens 504/0 e 0 to 0 dl 1788744685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788744674.291313:0:6688:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a23d155c00 with x1875634451149568 ext(0->12) 00010000:00010000:3.0:1788744674.291398:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eaa expref: 8 pid: 6685 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.291414:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eaa expref: 8 pid: 6685 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744674.291422:0:6688:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93a23d155c00 00000100:00100000:3.0:1788744674.291457:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:3.0:1788744674.291466:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2360:x1875634451149568:12345-192.168.201.6@tcp:4:lfs.0 00000001:00100000:1.0:1788744674.317588:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 390441fa-c0e0-4bda-b106-b1a75da212d8 00000100:00100000:3.0:1788744674.318619:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d155c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2360:x1875634451149568:12345-192.168.201.6@tcp:4:lfs.0 Request processed in 27146us (27931us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788744674.318632:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00002000:00100000:3.0:1788744674.318645:0:6688:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff93a23d155c00 x1875634451149568/t4294967299(0) o4->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:195/0 lens 504/448 e 0 to 0 dl 1788744685 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788744674.318667:0:6688:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a23d155c00 with x1875634451149568 ext(0->12) 00010000:00010000:3.0:1788744674.318678:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eaa expref: 9 pid: 6685 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.318697:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eaa expref: 9 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744674.318706:0:6688:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93a23d155c00 00000100:00100000:2.0:1788744674.322987:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744674.323254:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451149696 00000100:00100000:0.0:1788744674.323265:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451149696 00010000:00010000:0.0:1788744674.323303:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eaa expref: 9 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744674.323449:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:0.0:1788744674.323460:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d157480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2359:x1875634451149696:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744674.323477:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788744674.323497:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788744674.323500:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788744673 00002000:00010000:0.0:1788744674.323502:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788744673 00002000:00010000:0.0:1788744674.323504:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788744673 00010000:00010000:0.0:1788744674.323564:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eaa expref: 9 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.323602:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eaa expref: 9 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.323633:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb39227a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eaa expref: 9 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.323651:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788744674.323656:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744674.323662:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb3922c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.323672:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb3922c7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.323709:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744674.323813:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d157480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2359:x1875634451149696:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 354us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744674.323821:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00010000:00010000:1.0:1788744674.323885:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb3922c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.323907:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb3922c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.323932:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb3922c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.323940:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb3922c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.323949:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb3922c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.323957:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e7e00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744674.323961:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb3922c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.323969:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb3922c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.323981:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb3922c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.323988:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb3922c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744674.324048:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2359:x1875634451149440:12345-192.168.201.6@tcp:1:lfs.0 Request processed in 37304us (37941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744674.324057:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:3.0:1788744674.326811:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744674.326889:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451149952 00000100:00100000:2.0:1788744674.326899:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451149952 00000100:00100000:2.0:1788744674.326947:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:2.0:1788744674.326957:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+20:10296:x1875634451149952:12345-192.168.201.6@tcp:35:lfs.0 00000004:00010000:2.0:1788744674.327023:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3922b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ec6 expref: 20 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744674.327445:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788744674.327505:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788744674.328056:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788744674.328124:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb3922ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.328162:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39225e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e9c expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.328172:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb3922ce lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.328211:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39225e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e9c expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.328226:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39225e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e9c expref: 24 pid: 5841 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744674.328240:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d156680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1875634475301376:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744674.328789:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c40b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744674.335118:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744674.335638:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d156680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1875634475301376:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788744674.335670:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb3922ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744674.335993:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451150080 00000100:00100000:1.0:1788744674.336002:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451150080 00010000:00010000:1.0:1788744674.336107:0:7626:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39225e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e9c expref: 25 pid: 5841 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744674.336648:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:1.0:1788744674.336662:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+25:2360:x1875634451150080:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744674.336718:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744674.336739:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39225e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e9c expref: 25 pid: 5841 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.336768:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39225e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e9c expref: 25 pid: 5841 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.337110:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39225e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e9c expref: 25 pid: 5841 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.337168:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae100) 00010000:00010000:1.0:1788744674.337175:0:7626:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb3922ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.337185:0:7626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb3922ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.337213:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb3922ce lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.337239:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744674.337510:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+24:2360:x1875634451150080:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 660us (2210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744674.337520:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00010000:00010000:2.0:1788744674.337614:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb3922ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.337623:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb3922ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744674.337771:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788744674.339542:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788744674.339776:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d155f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875634475301504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788744674.340478:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744674.340512:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c40b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744674.341610:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475301504 00000100:00100000:3.0:1788744674.341621:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475301504 00000100:00100000:3.0:1788744674.341702:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744674.341712:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1875634475301504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788744674.341825:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1875634475301504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 114us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744674.341832:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788744674.341961:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744674.342068:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d155f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875634475301504:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788744674.344390:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788744674.344494:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875634475301632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788744674.344549:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744674.344692:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2036ae240 going to sleep for 11 seconds 00000100:00100000:2.0:1788744674.345441:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475301632 00000100:00100000:2.0:1788744674.345462:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475301632 00000100:00100000:2.0:1788744674.345545:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744674.345555:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1875634475301632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788744674.346029:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875634475301632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788744674.346090:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788744674.346159:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb3922ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.346177:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb3922ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.346185:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb3922ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.346191:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744674.346196:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb3922ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.346203:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb3922ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.346218:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae100) 00010000:00010000:0.0:1788744674.346220:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788744674.346225:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb3922ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744674.346231:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb3922ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788744674.346415:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788744674.346634:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788744674.346646:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 377045515526ns, next at 378045513479ns, rc = 0 00000001:00080000:0.0:1788744674.346653:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788744674.346688:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae100) 00010000:00010000:0.0:1788744674.346692:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788744674.346699:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3922b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ec6 expref: 28 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744674.347190:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+27:10296:x1875634451149952:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 20232us (20388us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788744674.347204:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000020:00080000:0.0:1788744674.347209:0:5843:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788744674.347393:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875634475301632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 222us (1226us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788744674.347404:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744674.350818:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744674.350900:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451150208 00000100:00100000:1.0:1788744674.350911:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451150208 00000100:00100000:1.0:1788744674.350965:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:1.0:1788744674.350974:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+27:10296:x1875634451150208:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788744674.350998:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744674.351032:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb3922d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54ecd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.351092:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb3922d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ecd expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.351108:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb3922d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ecd expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.351125:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:1.0:1788744674.351169:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744674.351173:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2027e7400, rc 0) 00000100:00100000:1.0:1788744674.351223:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+28:10296:x1875634451150208:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 250us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744674.351230:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:1.0:1788744674.356390:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744674.356478:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451150464 00000100:00100000:2.0:1788744674.356488:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451150464 00000100:00100000:2.0:1788744674.356570:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1788744674.356580:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a210e38850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+28:10296:x1875634451150464:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:2.0:1788744674.356856:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a210e38850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+29:10296:x1875634451150464:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 276us (542us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788744674.356863:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00010000:00010000:1.0:1788744674.421435:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744674.486803:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744674.487035:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451150720 00000100:00100000:1.0:1788744674.487045:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451150720 00000100:00100000:1.0:1788744674.487107:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:1.0:1788744674.487118:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+29:10306:x1875634451150720:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788744674.487180:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744674.487201:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7e00/0x4b162761eb3922dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54ed4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744674.487285:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788744674.487418:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7e00/0x4b162761eb3922dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ed4 expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.487446:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae400) 00010000:00010000:1.0:1788744674.487449:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744674.487455:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7e00/0x4b162761eb3922dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ed4 expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.487468:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2027e7e00, rc 0) 00000100:00100000:1.0:1788744674.487533:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+30:10306:x1875634451150720:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 417us (739us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788744674.487541:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:3.0:1788744674.491621:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744674.491796:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451150848 00000100:00100000:1.0:1788744674.491808:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451150848 00000100:00100000:1.0:1788744674.491891:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:1.0:1788744674.491901:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+30:10306:x1875634451150848:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:1.0:1788744674.491979:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb3922ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492020:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb3922ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492035:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb3922ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492052:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3922f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492059:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3922f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492066:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3922f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492208:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb3922f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492271:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb3922f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492280:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb3922f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744674.492542:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb3922f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492556:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb3922ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492562:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb3922ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492580:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb3922ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492594:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e6000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744674.492599:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb3922ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492607:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb3922ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492618:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:1.0:1788744674.492621:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744674.492626:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb3922ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492632:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e6000/0x4b162761eb3922ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492647:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3922f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492652:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3922f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492658:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3922f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492663:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e7200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744674.492666:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3922f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492682:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3922f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492690:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a203446000) 00010000:00010000:1.0:1788744674.492693:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744674.492696:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3922f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492701:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7200/0x4b162761eb3922f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492717:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb3922f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492723:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb3922f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492729:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb3922f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492734:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051aa00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744674.492737:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb3922f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492742:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb3922f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492749:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:1.0:1788744674.492751:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744674.492753:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb3922f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.492768:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb3922f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744674.492943:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+30:10306:x1875634451150848:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 1041us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744674.492951:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:3.0:1788744674.498213:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744674.499437:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451151104 00000100:00100000:0.0:1788744674.499448:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451151104 00000100:00100000:0.0:1788744674.499508:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:0.0:1788744674.499521:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+30:10306:x1875634451151104:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:0.0:1788744674.499796:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+31:10306:x1875634451151104:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 276us (1592us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788744674.499804:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:3.0:1788744674.583249:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744674.583415:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451151360 00000100:00100000:1.0:1788744674.583426:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451151360 00000100:00100000:1.0:1788744674.583492:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:1.0:1788744674.583501:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+31:10309:x1875634451151360:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788744674.583527:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744674.583549:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb3922ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54edb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.583635:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392306 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.583649:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392306 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.583660:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392306 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.583673:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39230d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.583680:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39230d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.583709:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39230d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584016:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392314 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584026:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392314 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584033:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392314 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744674.584043:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788744674.584178:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392306 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584186:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392306 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584193:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392306 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584199:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744674.584203:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392306 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584210:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392306 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584222:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:1.0:1788744674.584224:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744674.584237:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392306 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584243:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392306 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584255:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39230d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584260:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39230d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584266:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39230d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584270:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744674.584273:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39230d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584277:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39230d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584283:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a203446000) 00010000:00010000:1.0:1788744674.584286:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744674.584288:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39230d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584293:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39230d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584336:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb3922ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54edb expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584360:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392314 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54edb expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.584368:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:1.0:1788744674.584370:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744674.584373:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051bc00, rc 0) 00000100:00100000:1.0:1788744674.584444:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+33:10309:x1875634451151360:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 943us (1206us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788744674.584452:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:0.0:1788744674.588882:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744674.588995:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451151488 00000100:00100000:1.0:1788744674.589006:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451151488 00000100:00100000:1.0:1788744674.589065:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:1.0:1788744674.589077:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+33:10309:x1875634451151488:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:1.0:1788744674.589179:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392322 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.589199:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.589211:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.589242:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.589250:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392322 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.589272:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.589279:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744674.589283:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.589291:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392322 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.589303:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:1.0:1788744674.589306:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744674.589311:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392322 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744674.589317:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392322 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744674.589405:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+33:10309:x1875634451151488:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 330us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744674.589413:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:3.0:1788744674.591215:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744674.591310:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451151744 00000100:00100000:0.0:1788744674.591319:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451151744 00000100:00100000:0.0:1788744674.591381:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788744674.591391:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+33:10309:x1875634451151744:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:0.0:1788744674.591670:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+34:10309:x1875634451151744:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 278us (462us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788744674.591677:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788744674.921939:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744674.922043:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451152000 00000100:00100000:3.0:1788744674.922057:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451152000 00000100:00100000:3.0:1788744674.922121:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:3.0:1788744674.922165:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+34:10340:x1875634451152000:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:3.0:1788744674.922190:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744674.922211:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392329 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54ee2 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.922322:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392330 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.922339:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392330 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.922351:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392330 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744674.922364:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788744674.922533:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392329 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ee2 expref: 37 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.922554:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392330 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ee2 expref: 36 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744674.922564:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:3.0:1788744674.922567:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744674.922571:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80800, rc 0) 00000100:00100000:3.0:1788744674.922648:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+36:10340:x1875634451152000:12345-192.168.201.6@tcp:101:cat.0 Request processed in 517us (718us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788744674.922669:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:3.0:1788744674.926725:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744674.928864:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744674.929057:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451152384 00000100:00100000:2.0:1788744674.929069:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451152384 00000100:00100000:2.0:1788744674.929189:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:2.0:1788744674.929200:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202e0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+36:2359:x1875634451152384:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744674.929218:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744674.929245:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392330 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ee2 expref: 36 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744674.929267:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:2.0:1788744674.929272:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744674.929344:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202e0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+35:2359:x1875634451152384:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 146us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744674.929352:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:0.0:1788744674.940454:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451152256 00000100:00100000:0.0:1788744674.940471:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451152256 00000100:00100000:0.0:1788744674.940563:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1788744674.940574:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+35:10340:x1875634451152256:12345-192.168.201.6@tcp:35:cat.0 00000100:00100000:0.0:1788744674.940963:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+36:10340:x1875634451152256:12345-192.168.201.6@tcp:35:cat.0 Request processed in 390us (14250us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788744674.940971:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:3.0:1788744675.053248:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744675.053968:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451152640 00000100:00100000:1.0:1788744675.053980:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451152640 00000100:00100000:1.0:1788744675.054065:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:1.0:1788744675.054077:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+36:10346:x1875634451152640:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:1.0:1788744675.054108:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744675.054112:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788744675.054164:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392296 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54eb8 expref: 36 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.054204:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:1.0:1788744675.054210:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1788744675.054223:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788744675.054226:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb39233e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54ee9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.054328:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392345 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.054342:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392314 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54edb expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.054350:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392345 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.054385:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392314 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54edb expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.054399:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392314 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54edb expref: 36 pid: 5841 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744675.054412:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475301760:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744675.054499:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2011ca9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744675.064212:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744675.064285:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451152768 00000100:00100000:0.0:1788744675.064296:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451152768 00010000:00010000:0.0:1788744675.064343:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392314 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54edb expref: 37 pid: 5841 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744675.064387:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:0.0:1788744675.064398:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+37:2360:x1875634451152768:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744675.064414:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744675.064422:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392314 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54edb expref: 37 pid: 5841 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744675.064436:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392314 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54edb expref: 37 pid: 5841 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744675.064461:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:0.0:1788744675.064467:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392345 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744675.064478:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744675.064486:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392345 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744675.064526:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744675.064592:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+37:2360:x1875634451152768:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 196us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744675.064601:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00010000:00010000:2.0:1788744675.065085:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392314 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54edb expref: 36 pid: 5841 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744675.065105:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475301760:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744675.065153:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.065162:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.065168:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744675.065188:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788744675.065376:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb39233e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ee9 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.065391:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392345 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ee9 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.065400:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:2.0:1788744675.065404:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788744675.065407:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051a600, rc 0) 00000100:00100000:2.0:1788744675.065455:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+36:10346:x1875634451152640:12345-192.168.201.6@tcp:101:dd.0 Request processed in 11380us (12217us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788744675.065462:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:1.0:1788744675.077897:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744675.081810:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451153024 00000100:00100000:3.0:1788744675.081838:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451153024 00000100:00100000:3.0:1788744675.081922:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:3.0:1788744675.081934:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+36:10346:x1875634451153024:12345-192.168.201.6@tcp:36:dd.0 00010000:00010000:3.0:1788744675.082293:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392353 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744675.082501:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744675.082517:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744675.083091:0:11306:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788744675.083167:0:11306:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000006d7e906a reply state 00000000f8cb974c transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744675.083179:0:11306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788744675.083301:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+39:10346:x1875634451153024:12345-192.168.201.6@tcp:36:dd.0 Request processed in 1365us (5413us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788744675.083310:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00000020:00080000:0.0:1788744675.083315:0:11306:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788744675.090014:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744675.090033:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392353 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744675.090041:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392353 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744675.090047:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744675.090051:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392353 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744675.090077:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392353 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744675.090094:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:3.0:1788744675.090097:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744675.090102:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392353 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744675.090108:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392353 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744675.124748:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475302144:0@lo:400:kworker.0 00000100:00100000:2.0:1788744675.124820:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744675.124922:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475302144 00000100:00100000:2.0:1788744675.124930:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475302144 00000100:00100000:2.0:1788744675.124992:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788744675.125003:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475302144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744675.125056:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475302144:12345-0@lo:400:kworker.0 Request processed in 55us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744675.125062:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1788744675.125084:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744675.125113:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475302144:0@lo:400:kworker.0 00000100:00100000:2.0:1788744675.125173:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634475302272:0@lo:400:kworker.0 00000100:00100000:2.0:1788744675.125196:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744675.125226:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475302272 00000100:00100000:2.0:1788744675.125229:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475302272 00000100:00100000:2.0:1788744675.125255:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788744675.125260:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634475302272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744675.125292:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634475302272:12345-0@lo:400:kworker.0 Request processed in 32us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744675.125298:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788744675.127115:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475301888:0@lo:400:kworker.0 00000100:00100000:1.0:1788744675.127204:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744675.127280:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744675.127288:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475302016:0@lo:400:kworker.0 00000100:00100000:1.0:1788744675.127319:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744675.127360:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475301888 00000100:00100000:1.0:1788744675.127368:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475301888 00000100:00100000:1.0:1788744675.127414:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788744675.127422:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475301888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744675.127472:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3307:x1875634475301888:12345-0@lo:400:kworker.0 Request processed in 50us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744675.127479:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788744675.127514:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475302016 00000100:00100000:1.0:1788744675.127532:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475302016 00000100:00100000:1.0:1788744675.127559:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788744675.127566:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475302016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744675.127609:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475302016:12345-0@lo:400:kworker.0 Request processed in 43us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744675.127615:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788744675.127647:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d155880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475302016:0@lo:400:kworker.0 00000100:00100000:1.0:1788744675.127656:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475301888:0@lo:400:kworker.0 00000100:00080000:1.0:1788744675.127701:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744675.127736:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744675.127743:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475302400:0@lo:400:kworker.0 00000100:00100000:1.0:1788744675.127771:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744675.127800:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475302400 00000100:00100000:1.0:1788744675.127804:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475302400 00000100:00100000:1.0:1788744675.127843:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788744675.127849:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475302400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744675.127892:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475302400:12345-0@lo:400:kworker.0 Request processed in 43us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744675.127899:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788744675.127915:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744675.127930:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475302400:0@lo:400:kworker.0 00000100:00100000:1.0:1788744675.127977:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634475302272:0@lo:400:kworker.0 00000001:00080000:3.0:1788744675.224425:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000004:00080000:3.0:1788744675.224448:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788744675.226517:0:11963:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93a2036aea80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788744675.226526:0:11963:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93a23c085f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93a2036ae3c0 00000020:00080000:1.0:1788744675.226530:0:11963:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93a23c085800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93a241d56c00 00000020:00080000:1.0:1788744675.226554:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788744675.226741:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788744675.233324:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744675.233352:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475302528:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788744675.233425:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744675.233693:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475302528 00000100:00100000:2.0:1788744675.233702:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475302528 00000100:00100000:2.0:1788744675.233770:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788744675.233781:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875634475302528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788744675.233810:0:6682:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788744675.233856:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9e13e1, atime: 0x6a9e13e1, ctime: 0x6a9e13e1, blocks: 0x1 00010000:00010000:2.0:1788744675.233865:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000794c09d4/0x4b162761eb39235a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.233901:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1788744675.233906:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744675.233913:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000794c09d4/0x4b162761eb39235a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.233930:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000794c09d4/0x4b162761eb39235a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.233942:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000794c09d4/0x4b162761eb39235a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.233950:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000794c09d4/0x4b162761eb39235a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.233975:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788744675.234632:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1875634475302528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 850us (1204us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788744675.234641:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788744675.234990:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744675.234999:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000794c09d4/0x4b162761eb39235a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744675.235009:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3400 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744675.235014:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000794c09d4/0x4b162761eb39235a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744675.235025:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000794c09d4/0x4b162761eb39235a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744675.235061:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000794c09d4/0x4b162761eb39235a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744675.235070:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000794c09d4/0x4b162761eb39235a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744675.235096:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744675.235098:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744675.235100:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788744675.235183:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93a241d45180/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788744675.235191:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475302528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788744675.442631:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744675.442728:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451153152 00000100:00100000:2.0:1788744675.442739:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451153152 00000100:00100000:1.0:1788744675.443090:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:1.0:1788744675.443104:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+11:10360:x1875634451153152:12345-192.168.201.6@tcp:101:stat.0 00010000:00010000:1.0:1788744675.443397:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744675.443422:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392361 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54ef0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.443566:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392368 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.443592:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392368 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.443606:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392368 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.443643:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb39236f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.443651:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb39236f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.443658:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb39236f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744675.444645:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744675.444802:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392376 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.445047:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392345 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ee9 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.445059:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392376 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.445100:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392345 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ee9 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.445115:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392345 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ee9 expref: 12 pid: 5842 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744675.445470:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475302656:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744675.445723:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203fb69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744675.449761:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744675.449875:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475302656:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744675.449901:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392376 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744675.450006:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451153408 00000100:00100000:2.0:1788744675.450015:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451153408 00000100:00100000:2.0:1788744675.450078:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:2.0:1788744675.450088:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+13:5600:x1875634451153408:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788744675.452000:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+14:5600:x1875634451153408:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 1893us (2227us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788744675.452043:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:3.0:1788744675.455587:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744675.456275:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451153536 00000100:00100000:2.0:1788744675.456286:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451153536 00010000:00010000:2.0:1788744675.456410:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392345 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ee9 expref: 14 pid: 5842 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744675.456503:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:2.0:1788744675.456514:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+14:2359:x1875634451153536:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744675.456529:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744675.456536:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392345 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ee9 expref: 14 pid: 5842 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.456550:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392345 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ee9 expref: 14 pid: 5842 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.456583:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392345 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ee9 expref: 14 pid: 5842 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.456598:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:2.0:1788744675.456602:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392376 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.456611:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.456618:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392376 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.456666:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744675.456728:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+13:2359:x1875634451153536:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 215us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744675.456735:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00010000:00010000:1.0:1788744675.457786:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.457798:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744675.457860:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788744675.457866:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744675.457912:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.457927:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.457936:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392368 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.457942:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392368 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.457948:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392368 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.457954:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051ae00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744675.457958:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392368 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.457965:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392368 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.457977:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:1.0:1788744675.458267:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744675.458273:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392368 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.458280:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392368 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.458307:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb39236f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.458313:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb39236f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.458319:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb39236f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.458324:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744675.458327:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb39236f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.458332:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb39236f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.458340:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a203446000) 00010000:00010000:1.0:1788744675.458342:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744675.458345:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb39236f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.458351:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb39236f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.458392:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392361 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ef0 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.458420:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392376 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ef0 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.458427:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:1.0:1788744675.458429:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744675.458432:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051b400, rc 0) 00000100:00100000:1.0:1788744675.458515:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+12:10360:x1875634451153152:12345-192.168.201.6@tcp:101:stat.0 Request processed in 15415us (15894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744675.458524:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:0.0:1788744675.572260:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744675.572437:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451153792 00000100:00100000:1.0:1788744675.572447:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451153792 00000100:00100000:1.0:1788744675.572521:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:1.0:1788744675.572532:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+12:10366:x1875634451153792:12345-192.168.201.6@tcp:36:truncate.0 00010000:00010000:1.0:1788744675.572601:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744675.572631:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392376 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ef0 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.572656:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:1.0:1788744675.572665:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744675.573099:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39237d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.573115:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39237d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.573126:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39237d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744675.573256:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788744675.573280:0:5841:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000c8857788 reply state 00000000751ce128 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39237d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744675.573290:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788744675.573703:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+14:10366:x1875634451153792:12345-192.168.201.6@tcp:36:truncate.0 Request processed in 1171us (1452us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788744675.573713:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 54 00000020:00080000:1.0:1788744675.573720:0:5841:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788744675.592603:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39237d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.592621:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39237d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.592630:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39237d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.592636:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744675.592642:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39237d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.592649:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39237d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.592668:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:1.0:1788744675.592672:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744675.592678:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39237d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744675.592684:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39237d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744675.636717:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744675.636743:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475302784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744675.636835:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744675.636982:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475302784 00000100:00100000:0.0:1788744675.636991:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475302784 00000100:00100000:0.0:1788744675.637042:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788744675.637052:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475302784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744675.637090:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744675.637171:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475302784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744675.637177:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788744675.638666:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475302784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744675.733719:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744675.733841:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451153920 00000100:00100000:2.0:1788744675.733851:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451153920 00000100:00100000:2.0:1788744675.733909:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:2.0:1788744675.733920:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+13:10380:x1875634451153920:12345-192.168.201.6@tcp:101:stat.0 00010000:00010000:2.0:1788744675.733942:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744675.733962:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392384 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54ef7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734034:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb39238b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734048:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb39238b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734059:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb39238b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734072:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392392 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734078:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734084:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734437:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392399 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734447:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392399 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734454:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392399 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744675.734489:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788744675.734494:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744675.734517:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392399 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734529:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392399 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734538:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb39238b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734544:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb39238b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734551:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb39238b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734557:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744675.734561:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb39238b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734578:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb39238b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734597:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:2.0:1788744675.734599:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744675.734605:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb39238b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734611:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb39238b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734624:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734631:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392392 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734637:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392392 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734641:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744675.734644:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392392 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734649:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392392 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734656:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a209e2e600) 00010000:00010000:2.0:1788744675.734658:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744675.734660:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392392 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734665:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392392 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734703:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392384 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ef7 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734716:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392399 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ef7 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.734723:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:2.0:1788744675.734725:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744675.734728:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3600, rc 0) 00000100:00100000:2.0:1788744675.734790:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+14:10380:x1875634451153920:12345-192.168.201.6@tcp:101:stat.0 Request processed in 871us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744675.734797:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:0.0:1788744675.763049:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744675.763112:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744675.763184:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744675.763277:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451154304 00000100:00100000:3.0:1788744675.763289:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451154304 00000100:00100000:3.0:1788744675.763357:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 134 00000100:00100000:3.0:1788744675.763367:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451154304:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744675.763438:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451154304:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 73us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744675.763446:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 134 00000100:00100000:1.0:1788744675.763527:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451154176 00000100:00100000:1.0:1788744675.763532:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451154176 00000100:00100000:1.0:1788744675.763581:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:1.0:1788744675.763589:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2361:x1875634451154176:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744675.763616:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2361:x1875634451154176:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 30us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744675.763623:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:2.0:1788744675.763797:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451154048 00000100:00100000:2.0:1788744675.763802:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451154048 00000100:00100000:2.0:1788744675.763849:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 286 00000100:00100000:2.0:1788744675.763857:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2362:x1875634451154048:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744675.763886:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2362:x1875634451154048:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 30us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744675.763893:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 286 00000100:00080000:0.0:1788744675.764237:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744675.880190:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744675.881192:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451154560 00000100:00100000:2.0:1788744675.881205:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451154560 00000100:00100000:2.0:1788744675.881275:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:2.0:1788744675.881285:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+14:10391:x1875634451154560:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744675.881318:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744675.881343:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb3923a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54efe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744675.881457:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788744675.881728:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb3923a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54efe expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.881745:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae400) 00010000:00010000:2.0:1788744675.881748:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744675.881754:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb3923a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54efe expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744675.881958:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2e00, rc 0) 00000100:00100000:2.0:1788744675.882088:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+15:10391:x1875634451154560:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 804us (1907us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788744675.882097:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:0.0:1788744675.887681:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744675.887973:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451154816 00000100:00100000:1.0:1788744675.887984:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451154816 00000100:00100000:1.0:1788744675.888074:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:1.0:1788744675.888085:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+15:10391:x1875634451154816:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788744675.888601:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+16:10391:x1875634451154816:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 517us (930us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788744675.888609:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:0.0:1788744676.010543:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744676.010651:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451155072 00000100:00100000:3.0:1788744676.010677:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451155072 00000100:00100000:3.0:1788744676.010743:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:3.0:1788744676.010763:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+16:10397:x1875634451155072:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788744676.010790:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744676.010814:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3923ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f05 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.010928:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3923b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.010944:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392399 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ef7 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.010953:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3923b5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.010990:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392399 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ef7 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.011005:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392399 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ef7 expref: 17 pid: 5840 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744676.011020:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875634475302912:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788744676.011113:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20657e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744676.014649:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875634475302912:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744676.014681:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3923b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744676.017588:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744676.017830:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451155200 00000100:00100000:2.0:1788744676.017840:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451155200 00010000:00010000:2.0:1788744676.017895:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392399 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ef7 expref: 18 pid: 5840 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744676.017951:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:2.0:1788744676.017963:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+18:2359:x1875634451155200:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744676.017985:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744676.017993:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392399 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ef7 expref: 18 pid: 5840 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.018013:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392399 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ef7 expref: 18 pid: 5840 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.018063:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392399 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ef7 expref: 18 pid: 5840 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.018080:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:2.0:1788744676.018095:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3923b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.018104:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3923b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.018112:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3923b5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.018206:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744676.018267:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+17:2359:x1875634451155200:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 306us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744676.018274:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 40 00010000:00010000:0.0:1788744676.018927:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3923b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.018938:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3923b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744676.018972:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788744676.019359:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3923ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f05 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.019383:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3923b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f05 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.019392:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:0.0:1788744676.019403:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788744676.019407:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80800, rc 0) 00000100:00100000:0.0:1788744676.019469:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+17:10397:x1875634451155072:12345-192.168.201.6@tcp:101:bash.0 Request processed in 8711us (8929us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788744676.019477:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:0.0:1788744676.025390:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744676.025486:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451155456 00000100:00100000:2.0:1788744676.025498:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451155456 00000100:00100000:2.0:1788744676.025574:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:2.0:1788744676.025585:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+17:10397:x1875634451155456:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:2.0:1788744676.025943:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.025962:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.025976:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744676.026038:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788744676.026064:0:5840:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000e0ad8341 reply state 000000008caeaaa3 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744676.026073:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744676.026227:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+20:10397:x1875634451155456:12345-192.168.201.6@tcp:36:bash.0 Request processed in 643us (846us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788744676.026235:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 58 00000020:00080000:2.0:1788744676.026240:0:5840:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788744676.028895:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.028928:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.028936:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.028942:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744676.028947:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.028956:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.028973:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:3.0:1788744676.028976:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744676.028981:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.028987:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744676.039238:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744676.039704:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451155584 00000100:00100000:2.0:1788744676.039714:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451155584 00000100:00100000:2.0:1788744676.039776:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:2.0:1788744676.039786:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+19:10397:x1875634451155584:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788744676.039823:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744676.039845:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3923ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f0c expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.039938:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.039956:0:11306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3923b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f05 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.039965:0:11306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923d1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.040012:0:11306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3923b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f05 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.040046:0:11306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3923b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f05 expref: 20 pid: 5841 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744676.040060:0:11306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d46300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475303040:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744676.040188:0:11306:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c40b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744676.046072:0:11306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d46300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475303040:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788744676.046112:0:11306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744676.052851:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744676.052984:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451155712 00000100:00100000:3.0:1788744676.052995:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451155712 00010000:00010000:3.0:1788744676.053037:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3923b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f05 expref: 21 pid: 5841 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744676.053080:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:3.0:1788744676.053091:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+21:2361:x1875634451155712:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744676.053107:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744676.053276:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3923b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f05 expref: 21 pid: 5841 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.053291:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3923b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f05 expref: 21 pid: 5841 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.053314:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3923b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f05 expref: 21 pid: 5841 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.053332:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:3.0:1788744676.053338:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.053348:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.053356:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923d1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.053380:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744676.053530:0:11306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.053538:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744676.053602:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788744676.053608:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744676.053632:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.053663:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3923ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f0c expref: 21 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.053681:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f0c expref: 20 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.053688:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:0.0:1788744676.053691:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744676.053694:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3600, rc 0) 00000100:00100000:3.0:1788744676.053876:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+20:2361:x1875634451155712:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 785us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744676.053885:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:0.0:1788744676.059462:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+19:10397:x1875634451155584:12345-192.168.201.6@tcp:101:bash.0 Request processed in 19659us (20217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744676.059477:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:2.0:1788744676.066654:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744676.066732:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451155968 00000100:00100000:0.0:1788744676.066741:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451155968 00000100:00100000:0.0:1788744676.066819:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:0.0:1788744676.066830:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a210e3b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+19:10397:x1875634451155968:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:0.0:1788744676.067094:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a210e3b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+20:10397:x1875634451155968:12345-192.168.201.6@tcp:35:bash.0 Request processed in 265us (449us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788744676.067102:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:2.0:1788744676.148658:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744676.148683:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475303168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744676.148763:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744676.149087:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475303168 00000100:00100000:0.0:1788744676.149095:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475303168 00000100:00100000:0.0:1788744676.149195:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788744676.149205:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875634475303168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744676.149239:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744676.149295:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875634475303168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744676.149302:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788744676.149437:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475303168:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788744676.149569:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744676.178218:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744676.178381:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451156224 00000100:00100000:2.0:1788744676.178392:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451156224 00000100:00100000:2.0:1788744676.178454:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:2.0:1788744676.178465:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+20:10407:x1875634451156224:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744676.178501:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744676.178530:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3923d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f13 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744676.178635:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788744676.178766:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3923d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f13 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.178781:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae400) 00010000:00010000:2.0:1788744676.178783:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744676.178789:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3923d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f13 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.178831:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2c00, rc 0) 00000100:00100000:2.0:1788744676.178889:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+21:10407:x1875634451156224:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 426us (680us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788744676.178897:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:3.0:1788744676.190666:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744676.190845:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451156352 00000100:00100000:0.0:1788744676.190855:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451156352 00000100:00100000:0.0:1788744676.190922:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:0.0:1788744676.190933:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+21:10407:x1875634451156352:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:0.0:1788744676.191013:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3923e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191029:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3923e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191042:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3923e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191057:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3923ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191063:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3923ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191086:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3923ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191417:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3923f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191427:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3923f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191434:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3923f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744676.191478:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3923f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191492:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3923e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191498:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3923e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191516:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3923e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191522:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744676.191526:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3923e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191533:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3923e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191545:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:0.0:1788744676.191555:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744676.191570:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3923e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191576:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3923e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191590:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3923ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191595:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3923ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191600:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3923ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191605:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744676.191607:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3923ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191612:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3923ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191619:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a203c30600) 00010000:00010000:0.0:1788744676.191622:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744676.191624:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3923ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191629:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3923ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191643:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3923f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191655:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3923f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191661:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3923f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191666:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ec00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744676.191669:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3923f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191676:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3923f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191683:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:0.0:1788744676.191685:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744676.191688:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3923f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744676.191693:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3923f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744676.191765:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+21:10407:x1875634451156352:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 833us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744676.191774:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:0.0:1788744676.198253:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744676.198401:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451156608 00000100:00100000:1.0:1788744676.198411:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451156608 00000100:00100000:1.0:1788744676.198466:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:1.0:1788744676.198475:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+21:10407:x1875634451156608:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788744676.198778:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+22:10407:x1875634451156608:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 302us (533us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788744676.198786:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:1.0:1788744676.259213:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744676.260321:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451156864 00000100:00100000:2.0:1788744676.260334:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451156864 00000100:00100000:2.0:1788744676.260403:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:2.0:1788744676.260413:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+22:10410:x1875634451156864:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744676.260438:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744676.260460:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3923fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f1a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.260549:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392402 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.260583:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392402 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.260597:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392402 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.260613:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392409 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.260621:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.260627:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261009:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392410 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261020:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261028:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744676.261039:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788744676.261193:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392402 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261201:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392402 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261209:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392402 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261215:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2e00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744676.261221:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392402 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261229:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392402 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261242:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:2.0:1788744676.261245:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744676.261251:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392402 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261267:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392402 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261281:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261288:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392409 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261293:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392409 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261298:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744676.261301:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392409 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261307:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392409 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261314:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a209e2e600) 00010000:00010000:2.0:1788744676.261317:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744676.261319:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392409 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261325:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392409 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261373:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3923fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f1a expref: 25 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261387:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392410 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f1a expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.261399:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:2.0:1788744676.261401:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744676.261403:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2600, rc 0) 00000100:00100000:2.0:1788744676.261466:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+24:10410:x1875634451156864:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1054us (2261us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788744676.261473:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:0.0:1788744676.271478:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744676.271525:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744676.271665:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451156992 00000100:00100000:2.0:1788744676.271675:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451156992 00000100:00100000:2.0:1788744676.271754:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:2.0:1788744676.271765:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+24:2360:x1875634451156992:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744676.271785:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744676.271821:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392410 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f1a expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.271840:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:2.0:1788744676.271845:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744676.271907:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+23:2360:x1875634451156992:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 144us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744676.271914:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:3.0:1788744676.274549:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451157120 00000100:00100000:3.0:1788744676.274574:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451157120 00000100:00100000:3.0:1788744676.274673:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:3.0:1788744676.274685:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+23:10410:x1875634451157120:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:3.0:1788744676.274900:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39241e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.274920:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39241e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.274932:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39241e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.274959:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39241e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.274967:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39241e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.274974:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39241e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.274979:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744676.274983:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39241e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.274990:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39241e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.275001:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:3.0:1788744676.275004:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744676.275009:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39241e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.275015:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39241e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744676.275188:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+23:10410:x1875634451157120:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 505us (3660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744676.275196:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:0.0:1788744676.279121:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744676.279381:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451157376 00000100:00100000:1.0:1788744676.279402:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451157376 00000100:00100000:1.0:1788744676.279456:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:1.0:1788744676.279467:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+23:10410:x1875634451157376:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788744676.279731:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+24:10410:x1875634451157376:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 265us (621us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788744676.279738:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00010000:00010000:0.0:1788744676.468967:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744676.519851:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744676.519949:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451157632 00000100:00100000:1.0:1788744676.519959:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451157632 00000100:00100000:1.0:1788744676.520019:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:1.0:1788744676.520030:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+24:10427:x1875634451157632:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:1.0:1788744676.520055:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744676.520075:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392425 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f21 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.520221:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb39242c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.520237:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb39242c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.520249:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb39242c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744676.520260:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788744676.520422:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392425 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f21 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.520443:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb39242c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f21 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.520472:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:1.0:1788744676.520475:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788744676.520479:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051ac00, rc 0) 00000100:00100000:1.0:1788744676.520559:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+26:10427:x1875634451157632:12345-192.168.201.6@tcp:101:cat.0 Request processed in 523us (708us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788744676.520568:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:3.0:1788744676.570828:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744676.570968:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451157760 00000100:00100000:2.0:1788744676.570978:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451157760 00000100:00100000:2.0:1788744676.571040:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:2.0:1788744676.571050:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+26:10429:x1875634451157760:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744676.571075:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744676.571107:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39243a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f28 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.571210:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392441 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.571225:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.571237:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744676.571271:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788744676.571274:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744676.571290:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.571313:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39243a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f28 expref: 28 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.571330:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f28 expref: 27 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.571337:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:2.0:1788744676.571340:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744676.571344:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3400, rc 0) 00000100:00100000:2.0:1788744676.571408:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+27:10429:x1875634451157760:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 359us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744676.571415:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:0.0:1788744676.580333:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744676.580438:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451158144 00000100:00100000:1.0:1788744676.580448:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451158144 00000100:00100000:1.0:1788744676.580504:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:1.0:1788744676.580515:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+27:10429:x1875634451158144:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788744676.580880:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+28:10429:x1875634451158144:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 366us (557us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788744676.580889:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:0.0:1788744676.583678:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744676.584104:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451158272 00000100:00100000:2.0:1788744676.584174:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451158272 00000100:00100000:2.0:1788744676.584242:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:2.0:1788744676.584253:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+28:10429:x1875634451158272:12345-192.168.201.6@tcp:103:lfs.0 00010000:00010000:2.0:1788744676.584268:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788744676.584292:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3923d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f0c expref: 28 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.584314:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb39242c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f21 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.584328:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7400/0x4b162761eb3922d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ecd expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.584339:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446700) 00010000:00010000:2.0:1788744676.584350:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744676.584395:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+25:10429:x1875634451158272:12345-192.168.201.6@tcp:103:lfs.0 Request processed in 143us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744676.584402:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:3.0:1788744676.587510:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744676.592579:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451158400 00000100:00100000:1.0:1788744676.592596:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451158400 00000100:00100000:1.0:1788744676.592675:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:1.0:1788744676.592685:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+25:10429:x1875634451158400:12345-192.168.201.6@tcp:58:lfs.0 00010000:00010000:1.0:1788744676.592979:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392448 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.592999:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392448 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.593012:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392448 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744676.594013:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744676.595424:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788744676.595513:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788744676.595705:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+25:10429:x1875634451158400:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 3016us (8198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744676.595717:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:0.0:1788744676.620880:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744676.621029:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451158528 00000100:00100000:2.0:1788744676.621040:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451158528 00000100:00100000:2.0:1788744676.621100:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 67 00000100:00100000:2.0:1788744676.621111:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+25:10431:x1875634451158528:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744676.621173:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744676.621197:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb39244f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f2f expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621270:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392456 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621299:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392456 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621311:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392456 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621326:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb39245d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621332:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb39245d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621337:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb39245d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621565:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392464 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621575:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621583:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744676.621624:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788744676.621629:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744676.621649:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621661:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621680:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392456 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621687:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392456 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621694:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392456 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621700:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744676.621705:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392456 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621712:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392456 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621724:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:2.0:1788744676.621727:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744676.621732:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392456 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621739:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392456 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621751:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb39245d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621756:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb39245d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621762:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb39245d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621773:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2e00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744676.621776:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb39245d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621783:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb39245d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621791:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a209e2e600) 00010000:00010000:2.0:1788744676.621793:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744676.621796:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb39245d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621876:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb39245d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621909:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb39244f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f2f expref: 27 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621923:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f2f expref: 26 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.621931:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446000) 00010000:00010000:2.0:1788744676.621933:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744676.621935:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3000, rc 0) 00000100:00100000:2.0:1788744676.621999:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+26:10431:x1875634451158528:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 888us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744676.622007:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 67 00000040:00080000:1.0:1788744676.856452:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788744676.856463:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788744676.856517:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788744676.856523:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788744676.856667:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd9fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875634475303296:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788744676.856782:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203fb6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788744676.888052:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd9fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875634475303296:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788744676.897701:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744676.898420:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451158656 00000100:00100000:1.0:1788744676.898433:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451158656 00000100:00100000:1.0:1788744676.898497:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:1.0:1788744676.898508:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:390441fa-c0e0-4bda-b106-b1a75da212d8+26:10442:x1875634451158656:12345-192.168.201.6@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788744676.898594:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:390441fa-c0e0-4bda-b106-b1a75da212d8+26:10442:x1875634451158656:12345-192.168.201.6@tcp:900:lhsmtool_posix.0 Request processed in 89us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744676.898602:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:0.0:1788744676.902310:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744676.902393:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451158784 00000100:00100000:1.0:1788744676.902404:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451158784 00000100:00100000:1.0:1788744676.902484:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:1.0:1788744676.902495:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+26:10442:x1875634451158784:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788744676.902526:0:5840:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788744676.902654:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+26:10442:x1875634451158784:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 161us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744676.902662:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:2.0:1788744676.912728:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744676.912949:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451158912 00000100:00100000:3.0:1788744676.912960:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451158912 00000100:00100000:3.0:1788744676.913017:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:3.0:1788744676.913027:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+26:10442:x1875634451158912:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788744676.913118:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39246b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913168:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39246b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913180:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39246b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913196:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392472 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913203:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392472 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913209:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392472 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913234:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392479 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913254:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392479 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913262:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392479 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744676.913300:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788744676.913305:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744676.913317:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392479 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913328:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39246b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913335:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39246b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913343:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39246b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913350:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744676.913354:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39246b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913362:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39246b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913372:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93a203446f00) 00010000:00010000:3.0:1788744676.913375:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744676.913379:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39246b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913395:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39246b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913420:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392472 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913427:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392472 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913434:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392472 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913439:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744676.913443:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392472 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913449:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392472 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913457:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744676.913459:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744676.913462:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392472 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913469:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392472 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913482:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392479 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913488:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392479 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913500:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392479 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913505:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744676.913509:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392479 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913515:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392479 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913523:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446000) 00010000:00010000:3.0:1788744676.913526:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744676.913529:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392479 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.913535:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392479 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744676.913831:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+26:10442:x1875634451158912:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 Request processed in 803us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744676.913839:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:3.0:1788744676.922296:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744676.922950:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451159168 00000100:00100000:1.0:1788744676.922961:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451159168 00000100:00100000:1.0:1788744676.923025:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:1.0:1788744676.923035:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+26:10442:x1875634451159168:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744676.923055:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744676.923076:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392480 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f36 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.923505:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392487 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.923522:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.923535:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744676.923556:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788744676.923647:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.923654:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392487 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.923661:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392487 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.923667:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051ba00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744676.923683:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392487 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.923691:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392487 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.923703:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446000) 00010000:00010000:1.0:1788744676.923706:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744676.923711:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392487 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.923717:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392487 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.928988:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392480 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f36 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.929010:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93a203446f00) 00010000:00010000:1.0:1788744676.929014:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744676.929019:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392480 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f36 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744676.929036:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051a800, rc 0) 00000100:00100000:1.0:1788744676.933015:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+27:10442:x1875634451159168:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 6089us (6834us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788744676.933038:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:1.0:1788744676.948484:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744676.948572:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451159296 00000100:00100000:2.0:1788744676.948585:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451159296 00000100:00100000:2.0:1788744676.948654:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00100000:2.0:1788744676.948665:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+27:10442:x1875634451159296:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788744676.948704:0:5841:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788744676.948963:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+27:10442:x1875634451159296:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 298us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744676.948971:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00100000:0.0:1788744676.954203:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744676.954539:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451159552 00000100:00100000:3.0:1788744676.954558:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451159552 00000100:00100000:3.0:1788744676.954628:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 72 00000100:00100000:3.0:1788744676.954638:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+27:10442:x1875634451159552:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744676.954658:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744676.954662:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788744676.954689:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392441 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f28 expref: 27 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.954720:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:3.0:1788744676.954725:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744676.954752:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392495 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f3d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788744676.955615:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788744676.956231:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39249c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.956249:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39249c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.956261:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39249c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.956322:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392495 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f3d expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.956339:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39249c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f3d expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.956348:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744676.956350:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744676.956353:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80c00, rc 0) 00000100:00100000:3.0:1788744676.956476:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+28:10442:x1875634451159552:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1838us (2281us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788744676.956485:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 72 00000100:00100000:1.0:1788744676.961075:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744676.961301:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451159808 00000100:00100000:3.0:1788744676.961312:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451159808 00000100:00100000:3.0:1788744676.961398:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:3.0:1788744676.961409:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+28:10442:x1875634451159808:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788744676.961473:0:11306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744676.961503:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb39249c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f3d expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.961521:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744676.961531:0:11306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744676.961563:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3924aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.961579:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3924aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.961591:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3924aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.961673:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3924b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb8dedead bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.961682:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3924b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb8dedead bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.961690:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3924b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb8dedead bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.961915:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3924aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.961936:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3924aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.961943:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3924aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.961949:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744676.961953:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3924aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.961962:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3924aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.961973:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:3.0:1788744676.961975:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744676.961980:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3924aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.961985:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3924aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.961996:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3924b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb8dedead bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.962002:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3924b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb8dedead bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.962008:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3924b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb8dedead bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.962014:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744676.962022:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3924b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb8dedead bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.962029:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3924b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb8dedead bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.962037:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb8dedead (ffff93a21a9aee00) 00010000:00010000:3.0:1788744676.962040:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744676.962043:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3924b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb8dedead bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.962049:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3924b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb8dedead bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744676.962298:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+27:10442:x1875634451159808:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 890us (1231us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744676.962307:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:1.0:1788744676.964889:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744676.964978:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451159936 00000100:00100000:2.0:1788744676.964987:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451159936 00000100:00100000:2.0:1788744676.965073:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:2.0:1788744676.965083:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+27:10442:x1875634451159936:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744676.965103:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744676.965305:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb3924b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f44 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.965347:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3924bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.965360:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3924bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.965371:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3924bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.965467:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb3924b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f44 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.968875:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3924bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f44 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744676.968905:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:2.0:1788744676.968908:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788744676.968912:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2000, rc 0) 00000100:00100000:0.0:1788744676.969059:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+28:10442:x1875634451159936:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 3975us (4175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744676.969069:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:2.0:1788744676.971775:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744676.971895:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451160192 00000100:00100000:3.0:1788744676.971905:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451160192 00000100:00100000:3.0:1788744676.971967:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00100000:3.0:1788744676.971977:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+28:10442:x1875634451160192:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788744676.972056:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3924c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.972074:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3924c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.972086:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3924c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744676.972434:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788744676.972458:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379671327230ns, next at 380671324877ns, rc = 0 00000004:00010000:3.0:1788744676.972540:0:5841:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000052ca4c0a reply state 0000000064cd79bd transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3924c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744676.972565:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744676.972660:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+30:10442:x1875634451160192:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 684us (894us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788744676.972667:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 75 00010000:00010000:3.0:1788744676.974070:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3924c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.974084:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3924c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.974092:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3924c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.974098:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744676.974102:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3924c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.974110:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3924c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.974125:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:3.0:1788744676.974148:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788744676.974154:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3924c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.974160:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3924c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744676.975252:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744676.975461:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451160320 00000100:00100000:3.0:1788744676.975472:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451160320 00000100:00100000:3.0:1788744676.975529:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:3.0:1788744676.975540:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+29:10442:x1875634451160320:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744676.975572:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744676.975590:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb3924cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f4b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.975645:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb3924cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f4b expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.975658:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb3924cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f4b expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744676.975673:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:3.0:1788744676.975676:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744676.975678:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a201472e00, rc 0) 00000100:00100000:3.0:1788744676.975736:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+30:10442:x1875634451160320:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 194us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744676.975743:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:3.0:1788744676.978770:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744676.978885:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451160448 00000100:00100000:2.0:1788744676.978895:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451160448 00000100:00100000:2.0:1788744676.978950:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:2.0:1788744676.978958:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1875634451160448:12345-192.168.201.6@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788744676.978990:0:6682:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:2.0:1788744676.979018:0:6682:0:(genops.c:1384:class_connect()) connect: client 390441fa-c0e0-4bda-b106-b1a75da212d8, cookie 0x4b162761eb3924d4 00002000:00100000:2.0:1788744676.979030:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 390441fa-c0e0-4bda-b106-b1a75da212d8/ffff93a23cd4c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788744676.979042:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:2.0:1788744676.979318:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788744676.979348:0:6682:0:(import.c:65:import_set_state_nolock()) ffff93a23cd4e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744676.979415:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2358:x1875634451160448:12345-192.168.201.6@tcp:8:lhsmtool_posix.0 Request processed in 456us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744676.979423:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:3.0:1788744676.982405:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744676.982508:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451160576 00000100:00100000:1.0:1788744676.982532:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451160576 00000100:00100000:1.0:1788744676.982618:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:1.0:1788744676.982629:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+6:0:x1875634451160576:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788744676.982954:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744677.055316:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+7:0:x1875634451160576:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 72678us (72911us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788744677.055331:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 26 00000001:00080000:3.0:1788744677.055481:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1788744677.055494:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 390441fa-c0e0-4bda-b106-b1a75da212d8 00000100:00100000:3.0:1788744677.057769:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744677.057813:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451160832 00000100:00100000:3.0:1788744677.057835:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451160832 00000100:00100000:3.0:1788744677.057892:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1788744677.057903:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+30:10442:x1875634451160832:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788744677.058167:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+31:10442:x1875634451160832:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 265us (406us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788744677.058174:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00080000:3.0:1788744677.058194:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744677.063111:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744677.065272:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451161088 00000100:00100000:0.0:1788744677.065286:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451161088 00000100:00100000:0.0:1788744677.065345:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:0.0:1788744677.065354:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+31:10442:x1875634451161088:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788744677.065460:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+31:10442:x1875634451161088:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 107us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744677.065467:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:2.0:1788744677.072995:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744677.074342:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451161216 00000100:00100000:0.0:1788744677.074355:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451161216 00000100:00100000:0.0:1788744677.074419:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:0.0:1788744677.074428:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+31:10442:x1875634451161216:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744677.074451:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744677.074473:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb3924db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f52 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.074552:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3924e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.074567:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3924e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.074592:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3924e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744677.074632:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744677.074656:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3924e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.074681:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb3924db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f52 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.074697:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3924e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f52 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.074706:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:0.0:1788744677.074709:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788744677.074713:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17ea00, rc 0) 00000100:00100000:0.0:1788744677.074805:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+32:10442:x1875634451161216:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 368us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744677.074812:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:0.0:1788744677.078390:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744677.078499:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451161344 00000100:00100000:2.0:1788744677.078509:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451161344 00000100:00100000:2.0:1788744677.078574:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:2.0:1788744677.078584:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2360:x1875634451161344:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744677.078603:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744677.078634:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fe7a7f6/0x4b162761eb3924e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f59 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744677.078659:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e13e4, blocks: 0x1 00010000:00010000:2.0:1788744677.078678:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1788744677.078683:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744677.078691:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fe7a7f6/0x4b162761eb3924e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f59 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.078709:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005fe7a7f6/0x4b162761eb3924e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f59 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.078720:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2800, rc 0) 00000100:00100000:2.0:1788744677.078781:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2360:x1875634451161344:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 199us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744677.078788:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:2.0:1788744677.092202:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744677.092838:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451161600 00000100:00100000:0.0:1788744677.092849:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451161600 00000100:00100000:0.0:1788744677.092904:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:0.0:1788744677.092914:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+32:10442:x1875634451161600:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788744677.093015:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+32:10442:x1875634451161600:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 102us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744677.093022:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:0.0:1788744677.096695:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744677.104077:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451161728 00000100:00100000:1.0:1788744677.104094:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451161728 00000100:00100000:1.0:1788744677.104175:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:1.0:1788744677.104186:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:10442:x1875634451161728:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744677.104208:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744677.104231:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046e60949/0x4b162761eb3924f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f60 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.104262:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005fe7a7f6/0x4b162761eb3924e9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f59 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.104271:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744677.104276:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744677.104281:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046e60949/0x4b162761eb3924f0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f60 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.104316:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005fe7a7f6/0x4b162761eb3924e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f59 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.104344:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005fe7a7f6/0x4b162761eb3924e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f59 expref: 7 pid: 6682 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744677.104357:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d155880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1875634475303424:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744677.104461:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c785d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744677.108044:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744677.108093:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d155880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1875634475303424:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744677.108155:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046e60949/0x4b162761eb3924f0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f60 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.108175:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051b200, rc 0) 00000100:00100000:1.0:1788744677.108224:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+7:10442:x1875634451161728:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 4040us (11534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744677.108232:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:3.0:1788744677.109240:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451161856 00000100:00100000:3.0:1788744677.109252:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451161856 00010000:00010000:3.0:1788744677.109293:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005fe7a7f6/0x4b162761eb3924e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f59 expref: 7 pid: 6682 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744677.109333:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:3.0:1788744677.109343:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202e08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2360:x1875634451161856:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744677.109357:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744677.109380:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005fe7a7f6/0x4b162761eb3924e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f59 expref: 7 pid: 6682 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.109394:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005fe7a7f6/0x4b162761eb3924e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f59 expref: 7 pid: 6682 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.109421:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fe7a7f6/0x4b162761eb3924e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f59 expref: 7 pid: 6682 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.109438:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744677.109442:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744677.109464:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046e60949/0x4b162761eb3924f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f60 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.109474:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046e60949/0x4b162761eb3924f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f60 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.109513:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000046e60949/0x4b162761eb3924f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f60 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744677.109527:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d637b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1875634475303552:192.168.201.6@tcp:105: 00000100:00100000:3.0:1788744677.109601:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2204bda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744677.115197:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744677.116074:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451161984 00000100:00100000:2.0:1788744677.116087:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451161984 00002000:00100000:2.0:1788744677.116187:0:6690:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff93a23d155880 x1875634451161984/t0(0) o4->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:198/0 lens 504/0 e 0 to 0 dl 1788744688 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744677.116198:0:6690:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a23d155880 with x1875634451161984 ext(0->8) 00002000:00010000:2.0:1788744677.116204:0:6690:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93a23d155880 00000100:00100000:2.0:1788744677.116238:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:2.0:1788744677.116249:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2359:x1875634451161984:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788744677.116913:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2359:x1875634451161984:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 Request processed in 663us (1721us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788744677.116927:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00002000:00100000:2.0:1788744677.116936:0:6690:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff93a23d155880 x1875634451161984/t4294967302(0) o4->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:198/0 lens 504/448 e 0 to 0 dl 1788744688 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744677.116945:0:6690:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a23d155880 with x1875634451161984 ext(0->8) 00002000:00010000:2.0:1788744677.116951:0:6690:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93a23d155880 00000100:00100000:3.0:1788744677.123283:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d637b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1875634475303552:192.168.201.6@tcp:105: 00010000:00010000:3.0:1788744677.123311:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744677.123371:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202e08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2360:x1875634451161856:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 14029us (15334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744677.123381:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:2.0:1788744677.123551:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744677.124643:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451162112 00000100:00100000:3.0:1788744677.124655:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451162112 00000100:00100000:3.0:1788744677.124720:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:3.0:1788744677.124741:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+32:10442:x1875634451162112:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788744677.204250:0:11962:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967344 is committed 00000001:00080000:0.0:1788744677.204268:0:11962:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000020:00080000:0.0:1788744677.204287:0:11962:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1788744677.204307:0:11962:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1788744677.204313:0:11962:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788744677.204331:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788744677.204340:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788744677.204453:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475303680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788744677.204535:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744677.204626:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475303680 00000100:00100000:0.0:1788744677.204633:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475303680 00000100:00100000:0.0:1788744677.204678:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788744677.204686:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475303680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788744677.204903:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+13:10442:x1875634451162112:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 Request processed in 80170us (81360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744677.204911:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 80 00002000:00010000:0.0:1788744677.205462:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788744677.205467:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788744676 00002000:00010000:0.0:1788744677.205469:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788744677.205472:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788744676 -> 1788744676 00002000:00010000:0.0:1788744677.205474:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788744677.205611:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875634475303680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 925us (1076us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788744677.205618:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788744677.212217:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744677.214329:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000004:00080000:1.0:1788744677.217042:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93a23ccbad80/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788744677.217059:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475303680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788744677.219246:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451162240 00000100:00100000:3.0:1788744677.219261:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451162240 00000100:00100000:3.0:1788744677.219391:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:3.0:1788744677.219404:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2361:x1875634451162240:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788744677.309321:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1788744677.309344:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1788744677.309533:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2361:x1875634451162240:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 Request processed in 90127us (95209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744677.309573:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:1.0:1788744677.312492:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744677.317944:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451162496 00000100:00100000:2.0:1788744677.317974:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451162496 00000100:00100000:2.0:1788744677.318184:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:2.0:1788744677.318207:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+13:10442:x1875634451162496:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788744677.318322:0:11306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744677.318352:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3924e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f52 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.318386:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:2.0:1788744677.318392:0:11306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744677.318421:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3924f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.318436:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3924f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.318447:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3924f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744677.320603:0:11306:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000009181b436 reply state 0000000091a7323a transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3924f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744677.320624:0:11306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744677.320774:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+14:10442:x1875634451162496:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 2566us (8657us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788744677.320784:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:1.0:1788744677.333943:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:3.0:1788744677.334124:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3924f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.334170:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3924f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.334180:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3924f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.334186:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744677.334192:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3924f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.334199:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3924f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.334216:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:3.0:1788744677.334219:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744677.334224:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3924f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.334230:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3924f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744677.338919:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451162624 00000100:00100000:0.0:1788744677.338934:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451162624 00000100:00100000:3.0:1788744677.343834:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:3.0:1788744677.343847:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451162624:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788744677.344078:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788744677.344082:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788744676 -> 1788744675 00002000:00010000:3.0:1788744677.344084:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788744673 00002000:00010000:3.0:1788744677.344093:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788744676 -> 1788744675 00002000:00010000:3.0:1788744677.344096:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788744677.344186:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2359:x1875634451162624:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 341us (10254us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788744677.344194:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:0.0:1788744677.363042:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744677.363276:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451162880 00000100:00100000:3.0:1788744677.363288:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451162880 00000100:00100000:3.0:1788744677.363445:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:3.0:1788744677.363459:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+13:10442:x1875634451162880:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788744677.363534:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb3924fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.363662:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3924bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f44 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.363675:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb3924fe lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.363712:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3924bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f44 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.363859:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3924bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f44 expref: 13 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744677.363877:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d637b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875634475303808:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788744677.364016:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2012edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744677.374607:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d637b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875634475303808:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744677.374656:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb3924fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744677.374823:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744677.375019:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451163008 00000100:00100000:3.0:1788744677.375027:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451163008 00010000:00010000:3.0:1788744677.375062:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3924bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f44 expref: 14 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744677.375102:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:3.0:1788744677.375110:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+14:2359:x1875634451163008:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744677.375125:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744677.375152:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3924bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f44 expref: 14 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.375164:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3924bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f44 expref: 14 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.375184:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3924bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f44 expref: 14 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.375199:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:3.0:1788744677.375204:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb3924fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.375213:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb3924fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.375220:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb3924fe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.375252:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744677.375297:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+13:2359:x1875634451163008:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 187us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744677.375304:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00010000:00010000:3.0:1788744677.375328:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb3924fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.375335:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb3924fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.375364:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb3924fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.375371:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb3924fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.375378:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb3924fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.375383:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201473000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744677.375387:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb3924fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.375395:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb3924fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.375404:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:3.0:1788744677.375406:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788744677.375410:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb3924fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.375425:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb3924fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744677.375466:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+12:10442:x1875634451162880:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 Request processed in 12010us (12434us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788744677.375473:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:1.0:1788744677.378469:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744677.378563:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451163136 00000100:00100000:3.0:1788744677.378573:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451163136 00000100:00100000:3.0:1788744677.378632:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:3.0:1788744677.378642:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2362:x1875634451163136:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788744677.378700:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392505 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.378721:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046e60949/0x4b162761eb3924f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f60 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.378741:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788744677.378746:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744677.378750:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392505 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.378784:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046e60949/0x4b162761eb3924f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f60 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.378808:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046e60949/0x4b162761eb3924f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f60 expref: 7 pid: 6685 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744677.378836:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d637b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1875634475303936:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788744677.378910:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2012edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744677.381701:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744677.381745:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451163264 00000100:00100000:1.0:1788744677.381753:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451163264 00010000:00010000:1.0:1788744677.381793:0:7626:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046e60949/0x4b162761eb3924f0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f60 expref: 8 pid: 6685 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744677.381832:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:1.0:1788744677.381841:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2360:x1875634451163264:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744677.381856:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744677.381879:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046e60949/0x4b162761eb3924f0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f60 expref: 8 pid: 6685 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.381893:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046e60949/0x4b162761eb3924f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f60 expref: 8 pid: 6685 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.381919:0:7626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744677.381924:0:7626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744677.381930:0:7626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392505 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.381939:0:7626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392505 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.381958:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744677.382013:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2360:x1875634451163264:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 173us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744677.382020:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00010000:00010000:3.0:1788744677.382506:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046e60949/0x4b162761eb3924f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f60 expref: 7 pid: 6685 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744677.382522:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d637b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1875634475303936:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744677.382552:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392505 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.382562:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392505 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.382569:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392505 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.382596:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392505 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.382605:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392505 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.382612:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392505 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.382633:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81800 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744677.382638:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392505 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.382647:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392505 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.382661:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392505 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.382669:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392505 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744677.382734:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451163136:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 Request processed in 4093us (4276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744677.382742:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:3.0:1788744677.390309:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744677.390417:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451163520 00000100:00100000:0.0:1788744677.390428:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451163520 00000100:00100000:0.0:1788744677.390480:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 83 00000100:00100000:0.0:1788744677.390491:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+12:10442:x1875634451163520:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788744677.390601:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39250c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.390621:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39250c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.390634:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39250c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.391015:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392513 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.391028:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb3924cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f4b expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.391037:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392513 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.391068:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb3924cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f4b expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.391084:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb3924cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f4b expref: 13 pid: 5842 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744677.391098:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a2064ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475304064:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788744677.391264:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204c06b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744677.400941:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a2064ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475304064:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744677.400976:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392513 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744677.401924:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744677.401999:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451163648 00000100:00100000:2.0:1788744677.402008:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451163648 00010000:00010000:2.0:1788744677.402048:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb3924cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f4b expref: 14 pid: 5842 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744677.402088:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:2.0:1788744677.402099:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+14:2359:x1875634451163648:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744677.402113:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744677.402119:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb3924cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f4b expref: 14 pid: 5842 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.402154:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb3924cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f4b expref: 14 pid: 5842 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.402175:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb3924cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f4b expref: 14 pid: 5842 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.402200:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:2.0:1788744677.402205:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392513 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.402214:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392513 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.402220:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392513 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.402242:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744677.402292:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+13:2359:x1875634451163648:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 195us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744677.402299:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00010000:00010000:2.0:1788744677.402326:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392513 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.402332:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392513 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744677.402509:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788744677.402659:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788744677.402702:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788744677.403399:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c130e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1875634475304192:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788744677.403446:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744677.403465:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744677.403857:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475304192 00000100:00100000:3.0:1788744677.403865:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475304192 00000100:00100000:3.0:1788744677.403947:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744677.403957:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875634475304192:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788744677.404155:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1875634475304192:12345-0@lo:1000:mdt00_002.0 Request processed in 170us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744677.404162:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744677.410240:0:5842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788744677.410254:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93a23ccbad80, transno 4294967303 00000100:00100000:1.0:1788744677.411816:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c130e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1875634475304192:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788744677.412502:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1788744677.412602:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c137800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1875634475304320:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788744677.412666:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744677.412702:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a22051f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788744677.412735:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475304320 00000100:00100000:1.0:1788744677.412743:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475304320 00000100:00100000:1.0:1788744677.412794:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744677.412803:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875634475304320:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788744677.412975:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1875634475304320:12345-0@lo:1000:mdt00_002.0 Request processed in 172us (308us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788744677.412983:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744677.413030:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c137800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1875634475304320:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788744677.413064:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392513 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413075:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392513 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413084:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392513 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413091:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744677.413105:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392513 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413116:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392513 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413167:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:1.0:1788744677.413171:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744677.413176:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392513 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413183:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392513 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413221:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392448 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413229:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392448 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413234:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392448 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413239:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051ae00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744677.413242:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392448 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413248:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392448 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413256:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446000) 00010000:00010000:1.0:1788744677.413259:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744677.413270:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392448 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413275:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392448 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413299:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39251a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413315:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392464 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f2f expref: 16 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413324:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39251a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413349:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f2f expref: 16 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.413363:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392464 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f2f expref: 16 pid: 11306 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744677.413375:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c135180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475304448:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744677.413435:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23cde2540 going to sleep for 11 seconds 00000100:00100000:3.0:1788744677.417880:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744677.418105:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c135180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475304448:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744677.418160:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39251a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744677.418286:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451163776 00000100:00100000:1.0:1788744677.418294:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451163776 00010000:00010000:1.0:1788744677.418331:0:7626:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392464 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f2f expref: 17 pid: 11306 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744677.418362:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:1.0:1788744677.418372:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+17:2360:x1875634451163776:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744677.418397:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744677.418404:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392464 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f2f expref: 17 pid: 11306 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.418416:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f2f expref: 17 pid: 11306 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.418438:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392464 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f2f expref: 17 pid: 11306 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.418455:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446000) 00010000:00010000:1.0:1788744677.418460:0:7626:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39251a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.418470:0:7626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39251a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.418478:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39251a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.418510:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744677.418576:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+16:2360:x1875634451163776:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 206us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744677.418583:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00010000:00010000:2.0:1788744677.419209:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39251a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.419219:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39251a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.419232:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39251a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.419239:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39251a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.419245:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39251a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.419251:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744677.419255:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39251a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.419263:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39251a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.419275:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446000) 00010000:00010000:2.0:1788744677.419278:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744677.419282:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39251a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.419289:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb39251a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.419304:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39250c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.419319:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39250c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.419325:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39250c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.419330:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ec00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744677.419333:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39250c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.419339:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39250c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.419347:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203446000) 00010000:00010000:2.0:1788744677.419349:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788744677.419352:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39250c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.419357:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39250c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744677.419584:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+15:10442:x1875634451163520:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 29093us (29281us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788744677.419592:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 83 00000020:00080000:2.0:1788744677.419597:0:5842:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788744677.419836:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788744677.419840:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788744677.419868:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788744677.419873:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788744677.429856:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744677.429923:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451164032 00000100:00100000:1.0:1788744677.429933:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451164032 00000100:00100000:1.0:1788744677.429986:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1788744677.429996:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+15:10442:x1875634451164032:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788744677.430665:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788744677.430782:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788744677.430827:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392521 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.430845:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392521 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.430858:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392521 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.430868:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392521 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.430874:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392521 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.430880:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392521 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.430901:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788744677.430987:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+17:10442:x1875634451164032:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 991us (1138us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788744677.430996:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000020:00080000:1.0:1788744677.431001:0:5844:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788744677.431031:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744677.431037:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392521 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.431051:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a200 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744677.431054:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392521 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.431061:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392521 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.431073:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93a203446d00) 00010000:00010000:1.0:1788744677.431076:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788744677.431081:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392521 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.431086:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392521 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744677.431102:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744677.431103:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744677.431105:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788744677.463113:0:12004:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788744677.463124:0:12004:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788744677.463926:0:12004:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788744677.463933:0:12004:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788744677.503108:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744677.596276:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744677.596385:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451164288 00000100:00100000:2.0:1788744677.596394:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451164288 00000100:00100000:2.0:1788744677.596477:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:2.0:1788744677.596488:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+17:10452:x1875634451164288:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744677.596527:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744677.596562:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392528 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f67 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.596661:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3a00/0x4b162761eb39252f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.596677:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3a00/0x4b162761eb39252f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.596690:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3a00/0x4b162761eb39252f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744677.596702:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788744677.596823:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392528 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f67 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.596842:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3a00/0x4b162761eb39252f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f67 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.596849:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:2.0:1788744677.596852:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788744677.596856:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3a00, rc 0) 00000100:00100000:2.0:1788744677.596923:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+19:10452:x1875634451164288:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 437us (655us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788744677.596930:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:1.0:1788744677.608637:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744677.608979:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451164416 00000100:00100000:0.0:1788744677.608989:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451164416 00000100:00100000:0.0:1788744677.609064:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:0.0:1788744677.609074:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+19:10452:x1875634451164416:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:0.0:1788744677.609169:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb39253d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609187:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb39253d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609200:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb39253d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609215:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392544 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609223:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609229:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609481:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39254b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609489:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39254b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609496:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39254b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744677.609551:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39254b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609565:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb39253d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609577:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb39253d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609585:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb39253d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609591:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744677.609595:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb39253d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609602:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb39253d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609614:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:0.0:1788744677.609617:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744677.609622:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb39253d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609628:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb39253d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609642:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609648:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392544 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609654:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392544 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609658:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17fa00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744677.609669:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392544 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609675:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392544 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609683:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a203c30600) 00010000:00010000:0.0:1788744677.609686:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744677.609689:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392544 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609695:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392544 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609711:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39254b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609717:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39254b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609943:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39254b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609948:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744677.609951:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39254b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609957:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39254b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609966:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a203c30900) 00010000:00010000:0.0:1788744677.609968:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744677.609978:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39254b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.609983:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39254b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744677.610151:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+19:10452:x1875634451164416:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 1076us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744677.610161:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:0.0:1788744677.667873:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744677.668002:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451164672 00000100:00100000:3.0:1788744677.668013:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451164672 00000100:00100000:3.0:1788744677.668074:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:3.0:1788744677.668084:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+19:10455:x1875634451164672:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788744677.668107:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744677.668150:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392552 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f6e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.668228:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392559 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.668244:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392559 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.668259:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392559 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.668277:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392560 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.668286:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.668293:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.669857:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392567 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.669873:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.669894:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392567 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744677.672230:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788744677.672371:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392559 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.672380:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392559 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.672388:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392559 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.672394:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744677.672398:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392559 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.672406:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392559 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.672420:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:3.0:1788744677.672423:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744677.672428:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392559 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.672434:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392559 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.672446:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.672452:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392560 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.674593:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.674602:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744677.674607:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.674616:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392560 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.674631:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a21a9aee00) 00010000:00010000:3.0:1788744677.674634:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744677.674638:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392560 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.674645:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392560 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.674716:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392552 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f6e expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.674733:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392567 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f6e expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.674741:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744677.674743:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744677.674745:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80c00, rc 0) 00000100:00100000:3.0:1788744677.674817:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+21:10455:x1875634451164672:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 6734us (6956us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788744677.674842:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:1.0:1788744677.687244:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744677.687335:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451164800 00000100:00100000:3.0:1788744677.687346:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451164800 00000100:00100000:3.0:1788744677.687399:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 87 00000100:00100000:3.0:1788744677.687409:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+21:10455:x1875634451164800:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:3.0:1788744677.687600:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392575 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.687619:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.687632:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.687661:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.687669:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392575 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.687676:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.687683:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201472e00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744677.687687:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.687695:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392575 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.687707:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744677.687716:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744677.687734:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392575 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.687740:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb392575 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744677.687864:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+21:10455:x1875634451164800:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 455us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744677.687872:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 87 00000100:00100000:0.0:1788744677.691826:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744677.692150:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451165056 00000100:00100000:3.0:1788744677.692160:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451165056 00000100:00100000:3.0:1788744677.692210:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:3.0:1788744677.692219:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a210e3a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+21:10455:x1875634451165056:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1788744677.692442:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a210e3a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+22:10455:x1875634451165056:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 223us (632us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788744677.692449:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:0.0:1788744677.736484:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744677.736603:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451165312 00000100:00100000:3.0:1788744677.736614:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451165312 00000100:00100000:3.0:1788744677.736748:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 88 00000100:00100000:3.0:1788744677.736759:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+22:9983:x1875634451165312:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788744677.736784:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744677.736806:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb39257c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.737048:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392583 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.737065:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392567 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f6e expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.737090:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392583 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.738092:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392567 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f6e expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.738113:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392567 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f6e expref: 23 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744677.738257:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d636680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875634475304576:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788744677.738373:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2012edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744677.741756:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d636680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875634475304576:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744677.741801:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392583 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744677.747311:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744677.747627:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451165440 00000100:00100000:2.0:1788744677.747638:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451165440 00010000:00010000:2.0:1788744677.747683:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392567 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f6e expref: 24 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744677.747745:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:2.0:1788744677.747755:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+24:2360:x1875634451165440:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744677.747771:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744677.747778:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392567 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f6e expref: 24 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.747803:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392567 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f6e expref: 24 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.747827:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392567 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f6e expref: 24 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.747845:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:2.0:1788744677.747851:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392583 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.747861:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392583 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.747868:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392583 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.748015:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744677.748068:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+23:2360:x1875634451165440:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 313us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744677.748075:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00010000:00010000:3.0:1788744677.748174:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392583 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.748183:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392583 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744677.748202:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788744677.748357:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472e00/0x4b162761eb39257c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f75 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.748380:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392583 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f75 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.748402:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744677.748405:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788744677.748408:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a201473000, rc 0) 00000100:00100000:3.0:1788744677.748434:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+23:9983:x1875634451165312:12345-192.168.201.6@tcp:101:bash.0 Request processed in 11677us (11963us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788744677.748441:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 88 00000100:00100000:1.0:1788744677.751708:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744677.751984:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451165696 00000100:00100000:0.0:1788744677.751994:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451165696 00000100:00100000:0.0:1788744677.752121:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 89 00000100:00100000:0.0:1788744677.752164:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+23:9983:x1875634451165696:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:0.0:1788744677.752698:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392591 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.752716:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392591 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.752728:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392591 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744677.752793:0:11306:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788744677.752821:0:11306:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001be967e1 reply state 0000000006612324 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392591 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744677.752832:0:11306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788744677.753042:0:11306:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788744677.753247:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+27:9983:x1875634451165696:12345-192.168.201.6@tcp:36:bash.0 Request processed in 1114us (1546us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788744677.753255:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 89 00000020:00080000:0.0:1788744677.753260:0:11306:0:(tgt_main.c:545:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788744677.758416:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:3.0:1788744677.758961:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392591 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.758976:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392591 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.758985:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392591 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.758991:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744677.758996:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392591 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.759004:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392591 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.759022:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744677.759026:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744677.759032:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392591 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.759038:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392591 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744677.759395:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451165824 00000100:00100000:2.0:1788744677.759411:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451165824 00000100:00100000:2.0:1788744677.759469:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 90 00000100:00100000:2.0:1788744677.759479:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+26:9983:x1875634451165824:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788744677.759501:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744677.759520:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392598 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f7c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.759590:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392598 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f7c expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.759605:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392598 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f7c expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.759623:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:2.0:1788744677.759626:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744677.759629:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2c00, rc 0) 00000100:00100000:2.0:1788744677.762051:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+27:9983:x1875634451165824:12345-192.168.201.6@tcp:101:bash.0 Request processed in 218us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744677.762065:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 90 00000100:00100000:1.0:1788744677.763763:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744677.763858:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451165952 00000100:00100000:3.0:1788744677.763868:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451165952 00000100:00100000:3.0:1788744677.763934:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:3.0:1788744677.763945:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:9983:x1875634451165952:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788744677.763964:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744677.763986:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004682860c/0x4b162761eb39259f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f83 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744677.764011:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9e13e3, atime: 0x6a9e13e1, ctime: 0x6a9e13e3, blocks: 0xb 00010000:00010000:3.0:1788744677.764033:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=380s v=(0 0) 00010000:00010000:3.0:1788744677.764038:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744677.764047:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004682860c/0x4b162761eb39259f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f83 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.764062:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004682860c/0x4b162761eb39259f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f83 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.764074:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a201472e00, rc 0) 00000100:00100000:3.0:1788744677.765646:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+7:9983:x1875634451165952:12345-192.168.201.6@tcp:101:bash.0 Request processed in 1674us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744677.765665:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:0.0:1788744677.770913:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744677.771083:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451166080 00000100:00100000:3.0:1788744677.771092:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451166080 00002000:00010000:3.0:1788744677.771168:0:6688:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788744677.771173:0:6688:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a2064b9180 with x1875634451166080 ext(0->18446744073709551615) 00002000:00010000:3.0:1788744677.771197:0:6688:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93a2064b9180. 00000100:00100000:3.0:1788744677.771223:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:3.0:1788744677.771231:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2361:x1875634451166080:12345-192.168.201.6@tcp:10:bash.0 00002000:00010000:3.0:1788744677.771483:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788744677.771487:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788744675 -> 1788744676 00002000:00010000:3.0:1788744677.771489:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788744673 -> 1788744673 00002000:00010000:3.0:1788744677.771491:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788744675 -> 1788744676 00002000:00010000:3.0:1788744677.771494:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788744677.771557:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2361:x1875634451166080:12345-192.168.201.6@tcp:10:bash.0 Request processed in 326us (657us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788744677.771565:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00002000:00010000:3.0:1788744677.771569:0:6688:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788744677.771572:0:6688:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a2064b9180 with x1875634451166080 ext(0->18446744073709551615) 00002000:00010000:3.0:1788744677.771577:0:6688:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93a2064b9180. 00000100:00100000:1.0:1788744677.848497:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744677.848641:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451166208 00000100:00100000:3.0:1788744677.848651:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451166208 00000100:00100000:3.0:1788744677.848860:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00100000:3.0:1788744677.848872:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+27:10469:x1875634451166208:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:3.0:1788744677.848962:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.848981:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.848992:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849026:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849033:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849040:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849418:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3925b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849429:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3925b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849437:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3925b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744677.849490:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3925b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849503:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849509:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849517:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849523:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744677.849527:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849549:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849561:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:3.0:1788744677.849564:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744677.849568:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849575:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849589:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849595:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849601:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849606:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744677.849609:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849614:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849619:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a21a9ae000) 00010000:00010000:3.0:1788744677.849621:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744677.849624:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849639:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849653:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3925b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849658:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3925b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849663:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3925b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849668:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744677.849671:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3925b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849677:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3925b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849684:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744677.849686:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744677.849689:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3925b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.849694:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3925b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744677.851321:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+27:10469:x1875634451166208:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 2442us (2821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744677.851335:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00100000:0.0:1788744677.887476:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744677.887642:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451166464 00000100:00100000:3.0:1788744677.887651:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451166464 00000100:00100000:3.0:1788744677.887699:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:3.0:1788744677.887706:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+27:10472:x1875634451166464:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788744677.887736:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744677.887753:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3925bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f8a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.887815:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.887830:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.887842:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.887853:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.887858:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.887862:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888106:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3925d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888112:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3925d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888117:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3925d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744677.888126:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788744677.888245:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888250:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888255:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888258:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744677.888261:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888266:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888274:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:3.0:1788744677.888276:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744677.888279:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888283:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3925c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888291:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888295:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888299:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888301:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744677.888307:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888311:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888316:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a21a9ae000) 00010000:00010000:3.0:1788744677.888317:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744677.888318:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888322:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3925c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888352:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3925bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f8a expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888361:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3925d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f8a expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744677.888365:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744677.888367:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788744677.888368:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81400, rc 0) 00000100:00100000:3.0:1788744677.888582:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+29:10472:x1875634451166464:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 874us (1115us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788744677.888589:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:1.0:1788744677.894262:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744677.894346:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451166592 00000100:00100000:0.0:1788744677.894354:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451166592 00000100:00100000:0.0:1788744677.894403:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 93 00000100:00100000:0.0:1788744677.894413:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+29:10472:x1875634451166592:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:0.0:1788744677.894488:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3925de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.894506:0:11306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392583 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f75 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.894517:0:11306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3925de lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.894562:0:11306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392583 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f75 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.894576:0:11306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392583 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f75 expref: 29 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744677.894590:0:11306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a2064b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475304704:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788744677.894689:0:11306:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204c06780 going to sleep for 11 seconds 00000100:00100000:1.0:1788744677.898701:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744677.899083:0:11306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a2064b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475304704:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788744677.899362:0:11306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3925de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744677.899653:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451166848 00000100:00100000:3.0:1788744677.899662:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451166848 00000100:00100000:3.0:1788744677.900428:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:3.0:1788744677.900447:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+30:5599:x1875634451166848:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788744677.900928:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+31:5599:x1875634451166848:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 486us (2241us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788744677.900937:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:1.0:1788744677.903456:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744677.903559:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451166976 00000100:00100000:2.0:1788744677.903567:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451166976 00010000:00010000:2.0:1788744677.903608:0:7626:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392583 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f75 expref: 31 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744677.903647:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:2.0:1788744677.903668:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+31:2360:x1875634451166976:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744677.903685:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744677.903691:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392583 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f75 expref: 31 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.903703:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392583 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f75 expref: 31 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.903735:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a201473000/0x4b162761eb392583 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f75 expref: 31 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.903751:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:2.0:1788744677.903756:0:7626:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3925de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.903765:0:7626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3925de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.903772:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3925de lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.903847:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744677.903900:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+30:2360:x1875634451166976:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 233us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744677.903907:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00010000:00010000:0.0:1788744677.904970:0:11306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3925de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.904984:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3925de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.905018:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3925de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.905024:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3925de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.905032:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3925de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.905038:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744677.905042:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3925de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.905049:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3925de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.905062:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:0.0:1788744677.905064:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744677.905069:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3925de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.905075:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3925de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744677.905298:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+29:10472:x1875634451166592:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 10883us (11165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744677.905307:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 93 00000100:00100000:1.0:1788744677.908067:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744677.908451:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451167232 00000100:00100000:0.0:1788744677.908462:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451167232 00000100:00100000:0.0:1788744677.908597:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:0.0:1788744677.908609:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+29:10472:x1875634451167232:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:0.0:1788744677.909071:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+30:10472:x1875634451167232:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 461us (1013us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788744677.909079:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:1.0:1788744677.963452:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744677.963562:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451167488 00000100:00100000:2.0:1788744677.963572:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451167488 00000100:00100000:2.0:1788744677.963646:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:2.0:1788744677.963656:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+30:10483:x1875634451167488:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:2.0:1788744677.963697:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744677.963719:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb3925e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f91 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.963792:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3925ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.963808:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3925ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.963820:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3925ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.963836:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3925f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.963844:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3925f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.963851:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3925f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964114:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3925fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964125:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3925fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964170:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3925fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744677.964181:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788744677.964279:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3925ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964287:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3925ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964293:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3925ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964300:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744677.964304:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3925ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964312:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3925ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964325:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:2.0:1788744677.964328:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744677.964333:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3925ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964339:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3925ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964353:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3925f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964359:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3925f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964365:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3925f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964370:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744677.964380:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3925f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964386:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3925f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964395:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a209e2e100) 00010000:00010000:2.0:1788744677.964397:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744677.964400:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3925f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964406:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb3925f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964467:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb3925e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f91 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964481:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3925fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f91 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.964488:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:2.0:1788744677.964491:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744677.964493:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3800, rc 0) 00000100:00100000:2.0:1788744677.964990:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+32:10483:x1875634451167488:12345-192.168.201.6@tcp:101:cat.0 Request processed in 1333us (1546us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788744677.964999:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:1.0:1788744677.970499:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744677.970629:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451167744 00000100:00100000:3.0:1788744677.970640:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451167744 00000100:00100000:3.0:1788744677.970694:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:3.0:1788744677.970704:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+32:10483:x1875634451167744:12345-192.168.201.6@tcp:35:cat.0 00000100:00100000:3.0:1788744677.971118:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+33:10483:x1875634451167744:12345-192.168.201.6@tcp:35:cat.0 Request processed in 414us (628us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788744677.971195:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:1.0:1788744677.989435:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744677.989554:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451168000 00000100:00100000:2.0:1788744677.989566:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451168000 00000100:00100000:2.0:1788744677.989644:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00100000:2.0:1788744677.989656:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+33:10484:x1875634451168000:12345-192.168.201.6@tcp:36:rm.0 00010000:00010000:2.0:1788744677.989754:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788744677.989803:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3925fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f91 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.989831:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3925d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f8a expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.989845:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392598 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f7c expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.989856:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:2.0:1788744677.989867:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744677.989890:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392608 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.989905:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392608 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.989914:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392608 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.989928:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb39260f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.989936:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb39260f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.989942:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb39260f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.990442:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392616 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.990453:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392616 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.990460:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392616 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744677.991636:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788744677.991648:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 380690517637ns, next at 381690514952ns, rc = 0 00010000:00010000:2.0:1788744677.991717:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb39261d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.991731:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb39261d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.991742:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb39261d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.991750:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb39261d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.991757:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb39261d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.991763:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb39261d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.992280:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744677.992308:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392616 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.992326:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392616 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.992333:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392616 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.992339:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744677.992343:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392616 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.992350:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392616 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.992363:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:2.0:1788744677.992367:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788744677.992372:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392616 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.992378:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392616 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.992397:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392608 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.992404:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392608 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.992410:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392608 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.992415:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2e00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744677.992426:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392608 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.992432:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392608 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.992440:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:2.0:1788744677.992443:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744677.992446:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392608 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744677.992451:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392608 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744677.992461:0:5842:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000584ce019 reply state 000000004ffd72b3 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb39260f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744677.992471:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744677.992573:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+32:10484:x1875634451168000:12345-192.168.201.6@tcp:36:rm.0 Request processed in 2916us (3145us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788744677.992582:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 95 00010000:00010000:0.0:1788744677.992700:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744677.992707:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb39261d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.992714:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3400 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744677.992727:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb39261d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.992734:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb39261d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.992744:0:8445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:0.0:1788744677.992747:0:8445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788744677.992750:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb39261d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.992755:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb39261d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744677.992793:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744677.992795:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744677.992797:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744678.000432:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb39260f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.000454:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb39260f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.000462:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb39260f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.000469:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744678.000474:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb39260f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.000482:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb39260f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.000501:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a209e2e100) 00010000:00010000:3.0:1788744678.000504:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744678.000525:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb39260f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.000562:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb39260f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744678.035823:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744678.035984:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451168256 00000100:00100000:0.0:1788744678.035995:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451168256 00000100:00100000:0.0:1788744678.036060:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 96 00000100:00100000:0.0:1788744678.036071:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+31:10490:x1875634451168256:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1788744678.036095:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744678.036115:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392624 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f98 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.036277:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39262b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.036293:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39262b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.036304:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39262b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.036318:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392632 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.036326:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.036333:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788744678.036893:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788744678.037065:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.037076:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.037085:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.037118:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39262b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.037125:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39262b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.037161:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39262b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.037167:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ec00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744678.037171:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39262b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.037178:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39262b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.037189:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:0.0:1788744678.037193:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744678.037198:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39262b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.037204:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39262b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744678.037228:0:5840:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000157d75e5 reply state 000000004d64b8c8 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744678.037237:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788744678.037264:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392624 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f98 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.037279:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f98 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.037287:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30600) 00010000:00010000:0.0:1788744678.037290:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744678.037292:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17ee00, rc 0) 00000100:00100000:0.0:1788744678.037353:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+34:10490:x1875634451168256:12345-192.168.201.6@tcp:101:bash.0 Request processed in 1283us (1540us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788744678.037361:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 96 00010000:00010000:3.0:1788744678.040030:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.040048:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392632 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.040056:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392632 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.040062:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ea00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744678.040067:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392632 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.040075:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392632 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.040090:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a203c30900) 00010000:00010000:3.0:1788744678.040094:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744678.040098:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392632 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.040105:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392632 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744678.042752:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744678.042882:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451168384 00000100:00100000:3.0:1788744678.042892:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451168384 00000100:00100000:3.0:1788744678.042963:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:3.0:1788744678.042983:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2360:x1875634451168384:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788744678.043004:0:9032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744678.043030:0:9032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392647 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54f9f expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744678.043060:0:9032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744678.043081:0:9032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=380s v=(0 0) 00010000:00010000:3.0:1788744678.043086:0:9032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744678.043096:0:9032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f9f expref: 8 pid: 9032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.043119:0:9032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f9f expref: 8 pid: 9032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.043163:0:9032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80800, rc 0) 00000100:00100000:3.0:1788744678.043225:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2360:x1875634451168384:12345-192.168.201.6@tcp:101:bash.0 Request processed in 243us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744678.043232:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00080000:2.0:1788744678.043297:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744678.046387:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744678.046482:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451168512 00000100:00100000:2.0:1788744678.046492:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451168512 00000100:00100000:2.0:1788744678.046554:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:2.0:1788744678.046565:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+8:10490:x1875634451168512:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788744678.046584:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744678.046604:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54fa6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.046655:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392647 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f9f expref: 9 pid: 9032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.046671:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744678.046675:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744678.046680:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fa6 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.046725:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f9f expref: 9 pid: 9032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.046739:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f9f expref: 9 pid: 9032 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744678.046754:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c132d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1875634475304832:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744678.046854:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744678.050515:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c132d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1875634475304832:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744678.050561:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fa6 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.050581:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2e00, rc 0) 00000100:00100000:2.0:1788744678.050641:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+9:10490:x1875634451168512:12345-192.168.201.6@tcp:101:bash.0 Request processed in 4078us (4264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744678.050650:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:1.0:1788744678.052094:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744678.052215:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451168640 00000100:00100000:2.0:1788744678.052224:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451168640 00010000:00010000:2.0:1788744678.052262:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f9f expref: 9 pid: 9032 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744678.052321:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:2.0:1788744678.052332:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2360:x1875634451168640:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744678.052346:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744678.052370:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f9f expref: 9 pid: 9032 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.052385:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f9f expref: 9 pid: 9032 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.052408:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392647 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f9f expref: 9 pid: 9032 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.052426:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744678.052431:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744678.052438:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fa6 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.052448:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fa6 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.052483:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fa6 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744678.052497:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c132d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1875634475304960:192.168.201.6@tcp:105: 00000100:00100000:2.0:1788744678.052593:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744678.055333:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c132d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1875634475304960:192.168.201.6@tcp:105: 00010000:00010000:2.0:1788744678.055363:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744678.055421:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202e0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2360:x1875634451168640:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 3090us (3331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744678.055434:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:3.0:1788744678.057073:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744678.057257:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451168896 00000100:00100000:0.0:1788744678.057267:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451168896 00000100:00100000:0.0:1788744678.057321:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:0.0:1788744678.057331:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+33:10490:x1875634451168896:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:0.0:1788744678.057691:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+34:10490:x1875634451168896:12345-192.168.201.6@tcp:35:bash.0 Request processed in 360us (624us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788744678.057697:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:3.0:1788744678.247056:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744678.247187:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451169024 00000100:00100000:0.0:1788744678.247198:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451169024 00000100:00100000:0.0:1788744678.247256:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 97 00000100:00100000:0.0:1788744678.247265:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+34:10506:x1875634451169024:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788744678.247308:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744678.247331:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392655 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54fad expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.247399:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39265c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.247414:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39265c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.247426:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39265c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744678.247459:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788744678.247463:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744678.247480:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39265c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.247516:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fad expref: 36 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.247568:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39265c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fad expref: 35 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.247577:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:0.0:1788744678.247579:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744678.247583:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17ec00, rc 0) 00000100:00100000:0.0:1788744678.247648:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+35:10506:x1875634451169024:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 383us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744678.247655:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 97 00000100:00100000:1.0:1788744678.252214:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744678.252330:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451169280 00000100:00100000:0.0:1788744678.252341:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451169280 00000100:00100000:0.0:1788744678.252401:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:0.0:1788744678.252411:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+35:10506:x1875634451169280:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788744678.252435:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744678.252458:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392663 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54fb4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.252580:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39266a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.252594:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39266a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.252607:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39266a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744678.252620:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788744678.252766:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392663 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fb4 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.252799:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39266a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fb4 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.252808:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30600) 00010000:00010000:0.0:1788744678.252810:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744678.252814:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17e600, rc 0) 00000100:00100000:0.0:1788744678.252882:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+37:10506:x1875634451169280:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 472us (679us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788744678.252910:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:1.0:1788744678.257222:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744678.257315:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451169536 00000100:00100000:0.0:1788744678.257326:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451169536 00000100:00100000:0.0:1788744678.257379:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:0.0:1788744678.257390:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+37:10506:x1875634451169536:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788744678.257420:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744678.257448:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392678 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54fbb expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.257574:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb39267f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.257589:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb39267f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.257601:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb39267f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744678.257615:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788744678.257753:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392678 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fbb expref: 40 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.257784:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb39267f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fbb expref: 39 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.257793:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30600) 00010000:00010000:0.0:1788744678.257796:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788744678.257799:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17f600, rc 0) 00000100:00100000:0.0:1788744678.257873:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+39:10506:x1875634451169536:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 484us (663us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788744678.257880:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:1.0:1788744678.266211:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744678.266248:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744678.266379:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451169664 00000100:00100000:2.0:1788744678.266389:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451169664 00000100:00100000:2.0:1788744678.266459:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:2.0:1788744678.266471:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+39:2359:x1875634451169664:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744678.266496:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744678.266519:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39266a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fb4 expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.266547:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30600) 00010000:00010000:2.0:1788744678.266553:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744678.266604:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+38:2359:x1875634451169664:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 136us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744678.266611:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:3.0:1788744678.267998:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451169792 00000100:00100000:3.0:1788744678.268009:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451169792 00000100:00100000:3.0:1788744678.268061:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:3.0:1788744678.268070:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2359:x1875634451169792:12345-192.168.201.6@tcp:1:lfs.0 00010000:00010000:3.0:1788744678.268121:0:9032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000194d417b/0x4b162761eb39268d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.268177:0:9032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fa6 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.268185:0:9032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744678.268189:0:9032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744678.268194:0:9032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000194d417b/0x4b162761eb39268d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.268231:0:9032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fa6 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.268245:0:9032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fa6 expref: 8 pid: 6682 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744678.268260:0:9032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d635880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9032:1875634475305088:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788744678.268356:0:9032:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c785840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744678.272566:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744678.272724:0:9032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d635880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9032:1875634475305088:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744678.272757:0:9032:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000194d417b/0x4b162761eb39268d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744678.272915:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451169920 00000100:00100000:0.0:1788744678.272923:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451169920 00002000:00100000:0.0:1788744678.272969:0:6689:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93a23d355880 x1875634451169920/t0(0) o4->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:199/0 lens 504/0 e 0 to 0 dl 1788744689 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788744678.272978:0:6689:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a23d355880 with x1875634451169920 ext(0->8) 00010000:00010000:0.0:1788744678.272985:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fa6 expref: 9 pid: 6682 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.272999:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fa6 expref: 9 pid: 6682 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744678.273006:0:6689:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93a23d355880 00000100:00100000:0.0:1788744678.273051:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:0.0:1788744678.273061:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2359:x1875634451169920:12345-192.168.201.6@tcp:4:lfs.0 00000100:00100000:0.0:1788744678.273727:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+11:2359:x1875634451169920:12345-192.168.201.6@tcp:4:lfs.0 Request processed in 664us (1167us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788744678.273736:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00002000:00100000:0.0:1788744678.273743:0:6689:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93a23d355880 x1875634451169920/t4294967302(0) o4->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:199/0 lens 504/448 e 0 to 0 dl 1788744689 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788744678.273752:0:6689:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a23d355880 with x1875634451169920 ext(0->8) 00010000:00010000:0.0:1788744678.273759:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fa6 expref: 11 pid: 6682 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.273849:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fa6 expref: 11 pid: 6682 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744678.273857:0:6689:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93a23d355880 00000100:00100000:0.0:1788744678.277397:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744678.277511:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451170048 00000100:00100000:1.0:1788744678.277531:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451170048 00010000:00010000:1.0:1788744678.277573:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fa6 expref: 11 pid: 6682 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744678.277619:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:1.0:1788744678.277630:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+11:2359:x1875634451170048:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744678.277647:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788744678.277667:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788744678.277670:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788744677 00002000:00010000:1.0:1788744678.277672:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788744677 00002000:00010000:1.0:1788744678.277675:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788744677 00010000:00010000:1.0:1788744678.277681:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fa6 expref: 11 pid: 6682 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.277709:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fa6 expref: 11 pid: 6682 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.277734:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035d6e866/0x4b162761eb39264e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fa6 expref: 11 pid: 6682 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.277751:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744678.277755:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744678.277761:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000194d417b/0x4b162761eb39268d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.277772:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000194d417b/0x4b162761eb39268d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.277815:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744678.277880:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+10:2359:x1875634451170048:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 251us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744678.277887:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 50 00010000:00010000:3.0:1788744678.278121:0:9032:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000194d417b/0x4b162761eb39268d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.278173:0:9032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000194d417b/0x4b162761eb39268d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.278206:0:9032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000194d417b/0x4b162761eb39268d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.278213:0:9032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000194d417b/0x4b162761eb39268d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.278220:0:9032:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000194d417b/0x4b162761eb39268d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.278227:0:9032:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80c00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744678.278230:0:9032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000194d417b/0x4b162761eb39268d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.278238:0:9032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000194d417b/0x4b162761eb39268d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.278251:0:9032:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000194d417b/0x4b162761eb39268d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.278258:0:9032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000194d417b/0x4b162761eb39268d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744678.278307:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2359:x1875634451169792:12345-192.168.201.6@tcp:1:lfs.0 Request processed in 10237us (12058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744678.278314:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:1.0:1788744678.281945:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744678.282168:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451170304 00000100:00100000:0.0:1788744678.282180:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451170304 00000100:00100000:0.0:1788744678.282237:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:0.0:1788744678.282247:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a210e39850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+38:10506:x1875634451170304:12345-192.168.201.6@tcp:35:lfs.0 00000004:00010000:0.0:1788744678.282310:0:5843:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb39267f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fbb expref: 38 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744678.282570:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788744678.282618:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788744678.282923:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788744678.282979:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392694 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.282993:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392639 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f98 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.283002:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392694 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.283039:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f98 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.283072:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f98 expref: 42 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744678.283085:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a2064b8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1875634475305216:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788744678.283209:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204c06780 going to sleep for 11 seconds 00000100:00100000:1.0:1788744678.287212:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a2064b8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5843:1875634475305216:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744678.287248:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392694 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744678.288371:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744678.288765:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451170432 00000100:00100000:2.0:1788744678.288785:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451170432 00010000:00010000:2.0:1788744678.288837:0:7626:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f98 expref: 43 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744678.288886:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:2.0:1788744678.288898:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d355c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+43:2360:x1875634451170432:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744678.288937:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744678.288945:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f98 expref: 43 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.288960:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f98 expref: 43 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.288984:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392639 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f98 expref: 43 pid: 5840 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.289004:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30600) 00010000:00010000:2.0:1788744678.289009:0:7626:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392694 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.289019:0:7626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392694 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.289026:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392694 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.289064:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744678.289168:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d355c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+42:2360:x1875634451170432:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 272us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744678.289175:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00010000:00010000:0.0:1788744678.289493:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392694 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.289501:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392694 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744678.289642:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788744678.289858:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1788744678.289996:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a2064b9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875634475305344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788744678.290052:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744678.290094:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204c06900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744678.290371:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475305344 00000100:00100000:2.0:1788744678.290379:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475305344 00000100:00100000:2.0:1788744678.290442:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744678.290452:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5843:x1875634475305344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788744678.290547:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5843:x1875634475305344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 97us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744678.290563:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788744678.290666:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744678.291056:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a2064b9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875634475305344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788744678.291889:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788744678.291978:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a2064b9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875634475305472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788744678.292030:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744678.292072:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204c06540 going to sleep for 11 seconds 00000100:00100000:2.0:1788744678.292286:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475305472 00000100:00100000:2.0:1788744678.292294:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475305472 00000100:00100000:2.0:1788744678.292340:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744678.292349:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5843:x1875634475305472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788744678.292605:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5843:x1875634475305472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 256us (574us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788744678.292612:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744678.292699:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a2064b9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5843:1875634475305472:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788744678.292768:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788744678.292819:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392694 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.292828:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392694 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.292836:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392694 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.292842:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17fa00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744678.292846:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392694 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.292854:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392694 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.292868:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30600) 00010000:00010000:1.0:1788744678.292871:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788744678.292876:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392694 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.292882:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392694 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788744678.293046:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788744678.295867:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788744678.295889:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 380994758353ns, next at 381994754854ns, rc = 0 00000001:00080000:1.0:1788744678.295906:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788744678.295978:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30600) 00010000:00010000:1.0:1788744678.295983:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788744678.296008:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb39267f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fbb expref: 46 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744678.296211:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a210e39850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+45:10506:x1875634451170304:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 13964us (14273us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788744678.296222:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 26 00000020:00080000:1.0:1788744678.296228:0:5843:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788744678.300359:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744678.300434:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451170560 00000100:00100000:0.0:1788744678.300445:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451170560 00000100:00100000:0.0:1788744678.300514:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00100000:0.0:1788744678.300540:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+45:10506:x1875634451170560:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788744678.300564:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744678.300600:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39269b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54fc2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.300662:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39269b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fc2 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.300677:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39269b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fc2 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.300697:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:0.0:1788744678.300700:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744678.300703:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17e600, rc 0) 00000100:00100000:0.0:1788744678.300783:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+46:10506:x1875634451170560:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 260us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744678.300790:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00100000:0.0:1788744678.304961:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744678.305113:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451170816 00000100:00100000:3.0:1788744678.305172:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451170816 00000100:00100000:3.0:1788744678.305231:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:3.0:1788744678.305242:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+46:10506:x1875634451170816:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1788744678.305885:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+47:10506:x1875634451170816:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 642us (932us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1788744678.305896:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:1.0:1788744678.401248:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744678.401355:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451170944 00000100:00100000:0.0:1788744678.401366:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451170944 00000100:00100000:0.0:1788744678.401428:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 101 00000100:00100000:0.0:1788744678.401441:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+47:10516:x1875634451170944:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:0.0:1788744678.401540:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb3926a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.401561:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb3926a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.401577:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb3926a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.401613:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.401620:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.401627:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.401725:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3926b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.401734:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3926b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.401741:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3926b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744678.401907:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3926b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.401919:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb3926a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.401926:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb3926a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.401933:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb3926a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.401938:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744678.401942:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb3926a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.401956:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb3926a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.401968:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:0.0:1788744678.401971:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744678.401976:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb3926a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.401982:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb3926a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.401995:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.402000:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.402005:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.402010:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ea00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744678.402014:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.402020:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.402026:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a203c30000) 00010000:00010000:0.0:1788744678.402028:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744678.402030:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.402047:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.402060:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3926b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.402066:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3926b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.402072:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3926b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.402075:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744678.402078:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3926b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.402084:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3926b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.402090:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:0.0:1788744678.402092:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744678.402094:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3926b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.402099:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3926b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744678.402232:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+47:10516:x1875634451170944:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 793us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744678.402240:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 101 00000100:00100000:0.0:1788744678.451176:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744678.451305:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451171200 00000100:00100000:3.0:1788744678.451316:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451171200 00000100:00100000:3.0:1788744678.451396:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 102 00000100:00100000:3.0:1788744678.451409:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+47:10519:x1875634451171200:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788744678.451438:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744678.451467:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3926b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54fc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.451574:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3926be lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.451593:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3926be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.451606:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3926be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.451626:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3926c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.451634:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3926c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.451663:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3926c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.451903:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3926cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.451913:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3926cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.451920:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3926cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744678.451931:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788744678.452029:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3926be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.452037:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3926be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.452044:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3926be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.452051:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744678.452055:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3926be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.452063:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3926be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.452075:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:3.0:1788744678.452078:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744678.452091:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3926be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.452097:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb3926be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.452114:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3926c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.452120:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3926c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.452334:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3926c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.452340:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744678.452343:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3926c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.452350:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3926c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.452359:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a21a9ae000) 00010000:00010000:3.0:1788744678.452362:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744678.452365:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3926c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.452370:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3926c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.452418:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3926b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fc9 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.452445:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3926cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fc9 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.452452:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:3.0:1788744678.452455:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744678.452457:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81400, rc 0) 00000100:00100000:3.0:1788744678.452544:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+49:10519:x1875634451171200:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1138us (1379us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788744678.452553:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 102 00000100:00100000:1.0:1788744678.455560:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744678.455725:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451171328 00000100:00100000:2.0:1788744678.455735:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451171328 00000100:00100000:2.0:1788744678.455806:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 103 00000100:00100000:2.0:1788744678.455817:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+49:10519:x1875634451171328:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:2.0:1788744678.455891:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.455911:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.455923:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.455950:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.455957:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.455965:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.455989:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744678.455994:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.456001:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.456014:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:2.0:1788744678.456017:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744678.456022:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.456029:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744678.456112:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+49:10519:x1875634451171328:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 297us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744678.456120:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 103 00000100:00100000:1.0:1788744678.458284:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744678.458380:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451171584 00000100:00100000:2.0:1788744678.458389:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451171584 00000100:00100000:2.0:1788744678.458442:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:2.0:1788744678.458453:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+49:10519:x1875634451171584:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:2.0:1788744678.458698:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+50:10519:x1875634451171584:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 246us (423us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788744678.458719:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00010000:00010000:0.0:1788744678.517233:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744678.533346:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744678.533793:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451171840 00000100:00100000:0.0:1788744678.533804:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451171840 00000100:00100000:0.0:1788744678.533869:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 104 00000100:00100000:0.0:1788744678.533880:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+50:10529:x1875634451171840:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1788744678.533904:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744678.533908:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788744678.533936:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb39265c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fad expref: 50 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.533955:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:0.0:1788744678.533960:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744678.533973:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3926e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54fd0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.534069:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.534083:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3926cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fc9 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.534092:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926e8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.534607:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3926cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fc9 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.534625:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3926cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fc9 expref: 50 pid: 5840 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744678.534659:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a2064b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875634475305600:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788744678.535067:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204c06d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744678.545068:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744678.545301:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a2064b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875634475305600:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744678.545332:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744678.545571:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451171968 00000100:00100000:2.0:1788744678.545580:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451171968 00010000:00010000:2.0:1788744678.545627:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3926cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fc9 expref: 51 pid: 5840 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744678.545726:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:2.0:1788744678.545738:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+51:2360:x1875634451171968:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744678.545755:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744678.545763:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3926cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fc9 expref: 51 pid: 5840 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.545894:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3926cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fc9 expref: 51 pid: 5840 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.545917:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3926cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fc9 expref: 51 pid: 5840 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.545934:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:2.0:1788744678.545939:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.545947:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.545954:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926e8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.545984:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744678.546045:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+50:2360:x1875634451171968:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 307us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744678.546053:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00010000:00010000:0.0:1788744678.546954:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.546967:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744678.546991:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788744678.547195:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb3926e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd0 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.547217:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd0 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.547226:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:0.0:1788744678.547228:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788744678.547231:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17ea00, rc 0) 00000100:00100000:0.0:1788744678.547281:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+50:10529:x1875634451171840:12345-192.168.201.6@tcp:101:bash.0 Request processed in 13402us (13945us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788744678.547290:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 104 00000100:00100000:1.0:1788744678.552401:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744678.552668:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451172224 00000100:00100000:2.0:1788744678.552690:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451172224 00000100:00100000:2.0:1788744678.552757:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 105 00000100:00100000:2.0:1788744678.552767:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+50:10529:x1875634451172224:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:2.0:1788744678.553032:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.553050:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.553063:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744678.553113:0:11306:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788744678.553170:0:11306:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000f5f045ee reply state 000000000957d9ad transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744678.553180:0:11306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744678.553267:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+53:10529:x1875634451172224:12345-192.168.201.6@tcp:36:bash.0 Request processed in 501us (877us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788744678.553274:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 105 00000020:00080000:2.0:1788744678.553278:0:11306:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788744678.556123:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.556266:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.556274:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.556279:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744678.556284:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.556291:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.556323:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:3.0:1788744678.556326:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744678.556331:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.556337:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3926f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744678.558512:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744678.558761:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451172352 00000100:00100000:2.0:1788744678.558781:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451172352 00000100:00100000:2.0:1788744678.558843:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 106 00000100:00100000:2.0:1788744678.558854:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+52:10529:x1875634451172352:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788744678.558882:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744678.558904:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3926fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54fd7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.558989:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.559019:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926e8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd0 expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.559028:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.559067:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd0 expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.559082:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd0 expref: 53 pid: 5840 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744678.559097:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c132d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875634475305728:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744678.559212:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744678.562391:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744678.562620:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451172480 00000100:00100000:3.0:1788744678.562630:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451172480 00010000:00010000:3.0:1788744678.562672:0:7626:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926e8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd0 expref: 54 pid: 5840 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744678.562721:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:3.0:1788744678.562730:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+54:2359:x1875634451172480:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744678.562746:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744678.562752:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926e8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd0 expref: 54 pid: 5840 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.562765:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd0 expref: 54 pid: 5840 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.562797:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:3.0:1788744678.562802:0:7626:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.562811:0:7626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.562835:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.562855:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744678.562965:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+54:2359:x1875634451172480:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 235us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744678.562972:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00010000:00010000:2.0:1788744678.563181:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb3926e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd0 expref: 53 pid: 5840 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744678.563200:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c132d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875634475305728:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744678.563243:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.563252:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.563258:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744678.563302:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788744678.563312:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744678.563336:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.563365:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb3926fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd7 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.563379:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd7 expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.563387:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:2.0:1788744678.563389:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744678.563392:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3000, rc 0) 00000100:00100000:2.0:1788744678.563418:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+52:10529:x1875634451172352:12345-192.168.201.6@tcp:101:bash.0 Request processed in 4567us (4918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744678.563424:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 106 00000100:00100000:1.0:1788744678.572862:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744678.573758:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451172736 00000100:00100000:2.0:1788744678.573780:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451172736 00000100:00100000:2.0:1788744678.573847:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:2.0:1788744678.573858:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+52:10529:x1875634451172736:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:2.0:1788744678.574269:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+53:10529:x1875634451172736:12345-192.168.201.6@tcp:35:bash.0 Request processed in 411us (1414us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788744678.574279:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:0.0:1788744678.648833:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744678.648967:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451172864 00000100:00100000:2.0:1788744678.648977:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451172864 00000100:00100000:2.0:1788744678.649038:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 107 00000100:00100000:2.0:1788744678.649049:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+53:10535:x1875634451172864:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744678.649073:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744678.649107:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb39270b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54fde expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.649211:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb392712 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.649225:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb392712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.649237:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb392712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744678.649273:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788744678.649278:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744678.649295:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb392712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.649317:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb39270b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fde expref: 55 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.649335:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb392712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fde expref: 54 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.649343:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:2.0:1788744678.649346:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744678.649350:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3e00, rc 0) 00000100:00100000:2.0:1788744678.649414:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+54:10535:x1875634451172864:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 367us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744678.649421:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 107 00000100:00100000:1.0:1788744678.654825:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744678.654968:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451172992 00000100:00100000:3.0:1788744678.654980:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451172992 00000100:00100000:3.0:1788744678.655041:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 108 00000100:00100000:3.0:1788744678.655051:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+54:10535:x1875634451172992:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788744678.655073:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744678.655096:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392719 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54fe5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655200:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb392720 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655215:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb392720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655226:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb392720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655241:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb392727 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655249:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb392727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655275:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb392727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655361:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39272e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655369:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39272e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655376:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39272e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744678.655412:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788744678.655416:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744678.655432:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39272e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655443:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39272e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655452:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb392720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655459:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb392720 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655465:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb392720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655471:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200030800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744678.655475:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb392720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655489:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb392720 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655501:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:3.0:1788744678.655504:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744678.655508:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb392720 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655527:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb392720 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655542:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb392727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655548:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb392727 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655554:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb392727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655560:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200030400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744678.655562:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb392727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655568:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb392727 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655575:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a21a9ae000) 00010000:00010000:3.0:1788744678.655578:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744678.655580:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb392727 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655598:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb392727 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655629:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392719 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fe5 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655642:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39272e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fe5 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.655649:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:3.0:1788744678.655651:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744678.655654:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a200031e00, rc 0) 00000100:00100000:3.0:1788744678.655707:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+55:10535:x1875634451172992:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 658us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744678.655713:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 108 00000100:00100000:3.0:1788744678.660457:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744678.660578:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451173248 00000100:00100000:2.0:1788744678.660603:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451173248 00000100:00100000:2.0:1788744678.660668:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 109 00000100:00100000:2.0:1788744678.660680:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+55:10535:x1875634451173248:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744678.660707:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744678.660730:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb392735 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54fec expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.660846:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.660860:0:11306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd7 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.660870:0:11306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39272e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fe5 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.660878:0:11306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.660912:0:11306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39272e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fe5 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.660926:0:11306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39272e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fe5 expref: 56 pid: 5840 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744678.660939:0:11306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c132d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475305856:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744678.661049:0:11306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd7 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.661072:0:11306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd7 expref: 56 pid: 5841 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744678.661082:0:11306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c133100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475305984:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744678.661109:0:11306:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788744678.664261:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744678.664509:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451173376 00000100:00100000:3.0:1788744678.664530:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451173376 00010000:00010000:3.0:1788744678.664571:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39272e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fe5 expref: 57 pid: 5840 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744678.664616:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:3.0:1788744678.664627:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+57:2359:x1875634451173376:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744678.664644:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744678.664651:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39272e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fe5 expref: 57 pid: 5840 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.664682:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39272e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fe5 expref: 57 pid: 5840 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.664703:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:3.0:1788744678.664714:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.664723:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.664729:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744678.664795:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+57:2359:x1875634451173376:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 169us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744678.664803:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 54 00010000:00010000:0.0:1788744678.666621:0:11306:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.6@tcp) returned -22 from blocking AST (req@00000000ed0ea42f x1875634475305856) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39272e lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fe5 expref: 56 pid: 5840 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.666662:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39272e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fe5 expref: 56 pid: 5840 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744678.666680:0:11306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c132d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475305856:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788744678.666695:0:11306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c133100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475305984:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788744678.666729:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:0.0:1788744678.666734:0:11306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.666742:0:11306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.666751:0:11306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744678.668096:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744678.668276:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451173504 00000100:00100000:2.0:1788744678.668285:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451173504 00010000:00010000:2.0:1788744678.668326:0:7626:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd7 expref: 56 pid: 5841 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744678.668368:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:2.0:1788744678.668377:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+56:2360:x1875634451173504:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744678.668392:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744678.668398:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd7 expref: 56 pid: 5841 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.668411:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd7 expref: 56 pid: 5841 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.668432:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392704 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fd7 expref: 56 pid: 5841 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.668446:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:2.0:1788744678.668450:0:7626:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.668473:0:7626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.668492:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744678.668525:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744678.668577:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+55:2360:x1875634451173504:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 201us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744678.668585:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 55 00010000:00010000:0.0:1788744678.669175:0:11306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.669185:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744678.669207:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788744678.669359:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb392735 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fec expref: 56 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.669377:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fec expref: 55 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.669394:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:0.0:1788744678.669397:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788744678.669400:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2000, rc 0) 00000100:00100000:0.0:1788744678.669448:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+55:10535:x1875634451173248:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 8770us (9001us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788744678.669455:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 109 00000100:00100000:0.0:1788744678.672334:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744678.672592:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451173760 00000100:00100000:3.0:1788744678.672604:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451173760 00000100:00100000:3.0:1788744678.672667:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1788744678.672678:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+55:10535:x1875634451173760:12345-192.168.201.6@tcp:103:lfs.0 00010000:00010000:3.0:1788744678.672694:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744678.672826:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39269b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fc2 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744678.672843:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:3.0:1788744678.672848:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744678.672907:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+54:10535:x1875634451173760:12345-192.168.201.6@tcp:103:lfs.0 Request processed in 231us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744678.672932:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1788744678.674378:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744678.674471:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451173888 00000100:00100000:0.0:1788744678.674554:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451173888 00000100:00100000:0.0:1788744678.674610:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 110 00000100:00100000:0.0:1788744678.674619:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+54:10535:x1875634451173888:12345-192.168.201.6@tcp:58:lfs.0 00010000:00010000:0.0:1788744678.674881:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39274a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.674900:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39274a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744678.674913:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39274a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788744678.675115:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788744678.675363:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+54:10535:x1875634451173888:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 744us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744678.675373:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 110 00000100:00100000:2.0:1788744678.678365:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744678.678490:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451174016 00000100:00100000:1.0:1788744678.678500:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451174016 00000100:00100000:1.0:1788744678.678571:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 111 00000100:00100000:1.0:1788744678.678581:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+54:10535:x1875634451174016:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788744678.678604:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744678.678626:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392751 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54ff3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.678685:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39274a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.678695:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392751 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ff3 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.678739:0:5842:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39274a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.678753:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392751 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ff3 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.678774:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:1.0:1788744678.678778:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744678.678782:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392751 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ff3 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744678.678789:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051b400, rc 0) 00000100:00100000:1.0:1788744678.678934:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+55:10535:x1875634451174016:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 353us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744678.678940:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 111 00000040:00080000:2.0:1788744679.476775:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744679.476785:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744679.476841:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788744679.476858:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788744679.476993:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c132a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875634475306112:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788744679.477099:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788744679.482518:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c132a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875634475306112:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788744679.483582:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744679.483930:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451174144 00000100:00100000:3.0:1788744679.483939:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451174144 00000100:00100000:3.0:1788744679.484015:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 112 00000100:00100000:3.0:1788744679.484026:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+55:10536:x1875634451174144:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788744679.484057:0:5841:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788744679.484197:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+55:10536:x1875634451174144:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 173us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744679.484202:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 112 00000100:00080000:2.0:1788744679.485117:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744679.496963:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744679.497069:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451174272 00000100:00100000:0.0:1788744679.497081:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451174272 00000100:00100000:0.0:1788744679.497185:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 113 00000100:00100000:0.0:1788744679.497210:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+55:10536:x1875634451174272:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788744679.497304:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392758 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497320:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392758 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497334:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392758 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497392:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb39275f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497401:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb39275f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497408:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb39275f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497439:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392766 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497448:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497454:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744679.497521:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788744679.497526:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744679.497540:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497563:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392758 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497569:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392758 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497576:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392758 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497582:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17fa00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744679.497586:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392758 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497593:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392758 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497605:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93a203446f00) 00010000:00010000:0.0:1788744679.497608:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744679.497613:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392758 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497619:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392758 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497633:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb39275f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497638:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb39275f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497654:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb39275f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497666:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ee00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744679.497669:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb39275f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497675:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb39275f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497684:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff93a203c30000) 00010000:00010000:0.0:1788744679.497694:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744679.497698:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb39275f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497704:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb39275f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497719:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497725:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392766 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497731:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497736:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744679.497738:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497744:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392766 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497772:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:0.0:1788744679.497774:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744679.497778:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392766 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.497783:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392766 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744679.497856:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+55:10536:x1875634451174272:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 Request processed in 648us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744679.497864:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 113 00000100:00100000:1.0:1788744679.510538:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744679.510632:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451174528 00000100:00100000:2.0:1788744679.510643:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451174528 00000100:00100000:2.0:1788744679.510719:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 114 00000100:00100000:2.0:1788744679.510731:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+55:10536:x1875634451174528:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744679.510764:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744679.510786:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb39276d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d54ffa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.510918:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392774 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.510934:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.510946:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744679.510958:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788744679.511057:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.511065:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392774 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.511071:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392774 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.511088:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744679.511093:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392774 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.511100:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392774 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.511112:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:2.0:1788744679.511115:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788744679.511120:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392774 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.511166:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392774 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.511215:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb39276d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ffa expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.511226:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93a203446f00) 00010000:00010000:2.0:1788744679.511228:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744679.511232:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb39276d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ffa expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.511241:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2a00, rc 0) 00000100:00100000:2.0:1788744679.511300:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+56:10536:x1875634451174528:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 572us (773us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788744679.511307:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 114 00000100:00100000:2.0:1788744679.519902:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744679.519998:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451174656 00000100:00100000:0.0:1788744679.520009:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451174656 00000100:00100000:0.0:1788744679.520073:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:0.0:1788744679.520083:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+56:10536:x1875634451174656:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788744679.520163:0:11306:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788744679.520279:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+56:10536:x1875634451174656:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 197us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744679.520287:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:1.0:1788744679.527076:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744679.527341:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451174912 00000100:00100000:2.0:1788744679.527353:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451174912 00000100:00100000:2.0:1788744679.527424:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:2.0:1788744679.527981:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+56:10536:x1875634451174912:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744679.528005:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744679.528009:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788744679.528036:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb392712 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fde expref: 56 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.528055:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:2.0:1788744679.528076:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744679.528106:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392782 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55001 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744679.528681:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788744679.528900:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392789 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.528916:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.528926:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.528981:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392782 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55001 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.528998:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392789 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55001 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.529006:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93a209e2eb00) 00010000:00010000:2.0:1788744679.529009:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744679.529012:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2a00, rc 0) 00000100:00100000:2.0:1788744679.529074:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+57:10536:x1875634451174912:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1101us (2007us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788744679.534270:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744679.534688:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451175168 00000100:00100000:1.0:1788744679.534708:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451175168 00000100:00100000:2.0:1788744679.535470:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:1.0:1788744679.537020:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:1.0:1788744679.537040:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+57:10536:x1875634451175168:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788744679.537104:0:11306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744679.537152:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392789 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55001 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537193:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93a209e2eb00) 00010000:00010000:1.0:1788744679.537204:0:11306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744679.537226:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051be00/0x4b162761eb392797 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537240:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051be00/0x4b162761eb392797 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537250:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051be00/0x4b162761eb392797 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537262:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb39279e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x8e74b166 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537268:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb39279e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8e74b166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537273:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb39279e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8e74b166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537345:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051be00/0x4b162761eb392797 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537352:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051be00/0x4b162761eb392797 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537358:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051be00/0x4b162761eb392797 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537365:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051be00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744679.537369:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051be00/0x4b162761eb392797 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537383:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051be00/0x4b162761eb392797 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537390:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:1.0:1788744679.537393:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744679.537398:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051be00/0x4b162761eb392797 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537403:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051be00/0x4b162761eb392797 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537413:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb39279e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8e74b166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537418:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb39279e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8e74b166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537423:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb39279e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8e74b166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537437:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051ba00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744679.537440:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb39279e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8e74b166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537445:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb39279e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8e74b166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537452:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x8e74b166 (ffff93a203446d00) 00010000:00010000:1.0:1788744679.537454:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744679.537457:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb39279e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8e74b166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.537483:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb39279e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8e74b166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744679.537583:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+56:10536:x1875634451175168:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 551us (3324us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788744679.537590:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:3.0:1788744679.540617:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744679.541841:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451175296 00000100:00100000:2.0:1788744679.541855:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451175296 00000100:00100000:2.0:1788744679.542006:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00100000:2.0:1788744679.542018:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+56:10536:x1875634451175296:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744679.542055:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744679.542078:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb3927a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55008 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.542115:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3927ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.542159:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3927ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.542171:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3927ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.542273:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb3927a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55008 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.542292:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3927ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55008 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.542301:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93a209e2ea00) 00010000:00010000:2.0:1788744679.542304:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788744679.542307:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3200, rc 0) 00000100:00100000:2.0:1788744679.542363:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+57:10536:x1875634451175296:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 348us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744679.542370:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 118 00010000:00010000:3.0:1788744679.542958:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744679.547621:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744679.547895:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451175552 00000100:00100000:2.0:1788744679.547906:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451175552 00000100:00100000:2.0:1788744679.548030:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 119 00000100:00100000:2.0:1788744679.548042:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+57:10536:x1875634451175552:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788744679.548192:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb3927b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.548214:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb3927b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.548227:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb3927b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744679.548547:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788744679.548559:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382247428326ns, next at 383247425470ns, rc = 0 00000004:00010000:2.0:1788744679.548642:0:5842:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a66db1e2 reply state 0000000075a1d7e7 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb3927b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744679.548651:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744679.548786:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+59:10536:x1875634451175552:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 745us (1173us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788744679.548794:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 119 00010000:00010000:1.0:1788744679.551422:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb3927b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.551441:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb3927b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.551449:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb3927b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.551454:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3e00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744679.551459:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb3927b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.551478:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb3927b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.551497:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93a209e2ea00) 00010000:00010000:1.0:1788744679.551509:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788744679.551515:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb3927b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.551522:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3e00/0x4b162761eb3927b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744679.553950:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744679.555264:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451175680 00000100:00100000:0.0:1788744679.555281:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451175680 00000100:00100000:0.0:1788744679.555417:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:0.0:1788744679.555437:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+58:10536:x1875634451175680:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744679.555472:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744679.555493:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3927ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5500f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.555592:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3927ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5500f expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.555607:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3927ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5500f expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.555639:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93a209e2ea00) 00010000:00010000:0.0:1788744679.555643:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744679.555647:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17f200, rc 0) 00000100:00100000:0.0:1788744679.556001:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+59:10536:x1875634451175680:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 572us (2063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744679.556008:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:3.0:1788744679.558654:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744679.558697:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451175808 00000100:00100000:3.0:1788744679.558708:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451175808 00000100:00100000:3.0:1788744679.559003:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:3.0:1788744679.559015:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2359:x1875634451175808:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788744679.559370:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2359:x1875634451175808:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 357us (722us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788744679.559378:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00080000:2.0:1788744679.562047:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788744679.562186:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744679.562368:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451176064 00000100:00100000:2.0:1788744679.562377:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451176064 00000100:00100000:2.0:1788744679.562544:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:2.0:1788744679.562554:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+59:10536:x1875634451176064:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788744679.562959:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+60:10536:x1875634451176064:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 404us (776us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788744679.562968:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:3.0:1788744679.566376:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744679.566929:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451176320 00000100:00100000:2.0:1788744679.566941:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451176320 00000100:00100000:2.0:1788744679.567018:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:2.0:1788744679.567031:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+60:10536:x1875634451176320:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788744679.567185:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+60:10536:x1875634451176320:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 157us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744679.567192:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:3.0:1788744679.570233:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744679.570312:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451176448 00000100:00100000:0.0:1788744679.570324:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451176448 00000100:00100000:0.0:1788744679.570386:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:0.0:1788744679.570398:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+60:10536:x1875634451176448:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744679.570423:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744679.570467:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb3927c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55016 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.570557:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb3927c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.570570:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb3927c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.570581:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb3927c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744679.570634:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744679.570651:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb3927c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.570682:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb3927c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55016 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.570701:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb3927c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55016 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.570710:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93a209e2ea00) 00010000:00010000:0.0:1788744679.570713:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788744679.570717:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17ee00, rc 0) 00000100:00100000:0.0:1788744679.570789:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+61:10536:x1875634451176448:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 394us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744679.570794:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:2.0:1788744679.574636:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744679.575035:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451176576 00000100:00100000:1.0:1788744679.575046:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451176576 00000100:00100000:1.0:1788744679.575108:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:1.0:1788744679.575118:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2360:x1875634451176576:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744679.575290:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744679.575312:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d95a20bf/0x4b162761eb3927cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5501d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744679.575342:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e13e6, blocks: 0x1 00010000:00010000:1.0:1788744679.575361:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=382s v=(0 0) 00010000:00010000:1.0:1788744679.575365:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744679.575374:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d95a20bf/0x4b162761eb3927cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5501d expref: 10 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.575388:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d95a20bf/0x4b162761eb3927cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5501d expref: 10 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.575401:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051ba00, rc 0) 00000100:00100000:1.0:1788744679.575550:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+10:2360:x1875634451176576:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 432us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744679.575557:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:2.0:1788744679.577996:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744679.578209:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451176832 00000100:00100000:0.0:1788744679.578220:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451176832 00000100:00100000:0.0:1788744679.578284:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:0.0:1788744679.578294:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+61:10536:x1875634451176832:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788744679.578403:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+61:10536:x1875634451176832:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 110us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744679.578410:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:3.0:1788744679.581928:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744679.582488:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451176960 00000100:00100000:0.0:1788744679.582508:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451176960 00000100:00100000:2.0:1788744679.582847:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:2.0:1788744679.582861:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+10:10536:x1875634451176960:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744679.582881:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744679.582901:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc56c40/0x4b162761eb3927d6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55024 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.582935:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d95a20bf/0x4b162761eb3927cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5501d expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.582944:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744679.582949:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744679.582955:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc56c40/0x4b162761eb3927d6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55024 expref: 11 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.582991:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d95a20bf/0x4b162761eb3927cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5501d expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.583004:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d95a20bf/0x4b162761eb3927cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5501d expref: 11 pid: 6685 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744679.583040:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c131880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1875634475306240:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744679.583241:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788744679.587059:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744679.587827:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c131880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1875634475306240:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744679.587858:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cdc56c40/0x4b162761eb3927d6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55024 expref: 11 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.587875:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3c00, rc 0) 00000100:00100000:3.0:1788744679.587982:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+11:10536:x1875634451176960:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 5124us (6064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744679.587991:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:0.0:1788744679.588074:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451177088 00000100:00100000:0.0:1788744679.588095:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451177088 00010000:00010000:0.0:1788744679.588151:0:7626:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d95a20bf/0x4b162761eb3927cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5501d expref: 11 pid: 6685 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744679.588188:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:0.0:1788744679.588197:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c131c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+11:2359:x1875634451177088:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744679.588212:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744679.588233:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d95a20bf/0x4b162761eb3927cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5501d expref: 11 pid: 6685 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.588245:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d95a20bf/0x4b162761eb3927cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5501d expref: 11 pid: 6685 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.588272:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d95a20bf/0x4b162761eb3927cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5501d expref: 11 pid: 6685 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.588287:0:7626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744679.588292:0:7626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744679.588300:0:7626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc56c40/0x4b162761eb3927d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55024 expref: 10 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.588310:0:7626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc56c40/0x4b162761eb3927d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55024 expref: 10 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.588342:0:7626:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cdc56c40/0x4b162761eb3927d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55024 expref: 10 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744679.588369:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a2064b9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7626:1875634475306368:192.168.201.6@tcp:105: 00000100:00100000:0.0:1788744679.588432:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207e43780 going to sleep for 11 seconds 00000100:00100000:0.0:1788744679.592570:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a2064b9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7626:1875634475306368:192.168.201.6@tcp:105: 00010000:00010000:0.0:1788744679.592603:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744679.593291:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c131c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+10:2359:x1875634451177088:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 5092us (6235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744679.593301:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:1.0:1788744679.593706:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744679.594067:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451177216 00000100:00100000:3.0:1788744679.594076:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451177216 00002000:00100000:3.0:1788744679.594123:0:6690:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93a23d355c00 x1875634451177216/t0(0) o4->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:200/0 lens 504/0 e 0 to 0 dl 1788744690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788744679.594164:0:6690:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a23d355c00 with x1875634451177216 ext(0->12) 00002000:00010000:3.0:1788744679.594171:0:6690:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93a23d355c00 00000100:00100000:3.0:1788744679.594196:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:3.0:1788744679.594204:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+10:2359:x1875634451177216:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788744679.594648:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+12:2359:x1875634451177216:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 Request processed in 443us (941us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788744679.594940:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00002000:00100000:3.0:1788744679.594950:0:6690:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93a23d355c00 x1875634451177216/t4294967308(0) o4->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:200/0 lens 504/448 e 0 to 0 dl 1788744690 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788744679.594960:0:6690:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a23d355c00 with x1875634451177216 ext(0->12) 00002000:00010000:3.0:1788744679.594972:0:6690:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93a23d355c00 00000100:00100000:1.0:1788744679.598433:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744679.598532:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451177344 00000100:00100000:0.0:1788744679.598542:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451177344 00000100:00100000:0.0:1788744679.598635:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 124 00000100:00100000:0.0:1788744679.598646:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+61:10536:x1875634451177344:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788744679.643257:0:11962:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000020:00080000:1.0:1788744679.643281:0:11962:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93a204c06e40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788744679.643303:0:11962:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93a201326300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93a220495240 00000020:00080000:1.0:1788744679.643307:0:11962:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93a201326000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93a23d527800 00000020:00080000:1.0:1788744679.643360:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:2.0:1788744679.643553:0:11963:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788744679.643579:0:11963:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93a204ad9540 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788744679.643584:0:11963:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93a104bb1200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93a204ad93c0 00000020:00080000:2.0:1788744679.643587:0:11963:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93a104bb1b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93a105627400 00000001:00080000:2.0:1788744679.643595:0:11963:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1788744679.643601:0:11963:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1788744679.643621:0:11963:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:2.0:1788744679.644116:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475306496:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788744679.644209:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744679.644310:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475306496 00000100:00100000:3.0:1788744679.644318:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475306496 00000100:00100000:3.0:1788744679.644372:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788744679.644383:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3308:x1875634475306496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788744679.644417:0:9032:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1788744679.644466:0:9032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9e13e5, atime: 0x6a9e13e5, ctime: 0x6a9e13e5, blocks: 0x1 00010000:00010000:3.0:1788744679.644475:0:9032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057a32346/0x4b162761eb3927dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.644493:0:9032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=382s v=(0 0) 00010000:00010000:3.0:1788744679.644506:0:9032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744679.644512:0:9032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057a32346/0x4b162761eb3927dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.644532:0:9032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057a32346/0x4b162761eb3927dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.644541:0:9032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057a32346/0x4b162761eb3927dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.644548:0:9032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057a32346/0x4b162761eb3927dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.644566:0:9032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788744679.645442:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3308:x1875634475306496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1056us (1228us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788744679.645531:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:3.0:1788744679.645601:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93a23cd2e680/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788744679.645609:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475306496:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1788744679.645933:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788744679.646072:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788744679.647375:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475306624:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788744679.647438:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744679.647571:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475306752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788744679.647949:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+15:10536:x1875634451177344:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 Request processed in 49301us (49522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744679.647960:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 124 00010000:00010000:0.0:1788744679.647995:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744679.648005:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057a32346/0x4b162761eb3927dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.648017:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200030000 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744679.648021:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057a32346/0x4b162761eb3927dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.648032:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057a32346/0x4b162761eb3927dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.648073:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057a32346/0x4b162761eb3927dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.648087:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057a32346/0x4b162761eb3927dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.648112:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744679.648114:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744679.648115:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744679.651252:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744679.651554:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744679.651637:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475306624 00000100:00100000:1.0:1788744679.651648:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475306624 00000100:00100000:1.0:1788744679.651731:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451177472 00000100:00100000:1.0:1788744679.651735:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451177472 00000100:00080000:0.0:1788744679.651945:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744679.651994:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788744679.652005:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875634475306624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788744679.652047:0:6682:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1788744679.652077:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3efdbe4/0x4b162761eb3927e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.652099:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004682860c/0x4b162761eb39259f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f83 expref: 12 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.652109:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788744679.652113:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744679.652117:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3efdbe4/0x4b162761eb3927e4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.652208:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004682860c/0x4b162761eb39259f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f83 expref: 12 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.652225:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004682860c/0x4b162761eb39259f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f83 expref: 12 pid: 6684 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744679.652249:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1875634475306880:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744679.652333:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23cde2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744679.652354:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:1.0:1788744679.652363:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+12:2359:x1875634451177472:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788744679.665283:0:6685:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788744679.665302:0:6685:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788744679.665910:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1875634475306880:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744679.666412:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d3efdbe4/0x4b162761eb3927e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744679.666822:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744679.667362:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451177600 00000100:00100000:0.0:1788744679.667371:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451177600 00010000:00010000:0.0:1788744679.667413:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004682860c/0x4b162761eb39259f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f83 expref: 13 pid: 6684 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744679.667452:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:1.0:1788744679.667573:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475306752 00000100:00100000:1.0:1788744679.667578:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475306752 00000100:00100000:1.0:1788744679.667680:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788744679.667995:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+13:2359:x1875634451177600:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744679.668012:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744679.668020:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004682860c/0x4b162761eb39259f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f83 expref: 13 pid: 6684 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.668036:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004682860c/0x4b162761eb39259f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f83 expref: 13 pid: 6684 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.668075:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004682860c/0x4b162761eb39259f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f83 expref: 13 pid: 6684 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.668094:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744679.668099:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744679.668105:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3efdbe4/0x4b162761eb3927e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.668116:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3efdbe4/0x4b162761eb3927e4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.668173:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744679.668230:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+12:2359:x1875634451177600:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 769us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744679.668238:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:1.0:1788744679.668616:0:12018:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3310:x1875634475306752:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788744679.668640:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d3efdbe4/0x4b162761eb3927e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.668650:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3efdbe4/0x4b162761eb3927e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.668659:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3efdbe4/0x4b162761eb3927e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.668668:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3efdbe4/0x4b162761eb3927e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.669881:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744679.670177:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744679.670186:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3efdbe4/0x4b162761eb3927e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.670199:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051be00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744679.670203:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3efdbe4/0x4b162761eb3927e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.670235:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3efdbe4/0x4b162761eb3927e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.670256:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3efdbe4/0x4b162761eb3927e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.670264:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3efdbe4/0x4b162761eb3927e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.670287:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744679.670288:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744679.670290:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744679.671357:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3309:x1875634475306624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19348us (23912us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788744679.671370:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1788744679.671440:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93a23d356d80/2, rc 0, transno 4294967309 00000100:00100000:1.0:1788744679.671447:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475306624:0@lo:6:osp-syn-1-0.0 00002000:00010000:1.0:1788744679.671655:0:12018:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788744679.671659:0:12018:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788744678 00002000:00010000:1.0:1788744679.671662:0:12018:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788744679.671664:0:12018:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788744678 -> 1788744678 00002000:00010000:1.0:1788744679.671666:0:12018:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788744679.671713:0:12018:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3310:x1875634475306752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4026us (20159us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788744679.671720:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:1.0:1788744679.671806:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93a23d355500/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788744679.671812:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475306752:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1788744679.706362:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1788744679.706381:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1788744679.706623:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451177472:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 Request processed in 54255us (55376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744679.706635:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:3.0:1788744679.710504:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744679.710680:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451177856 00000100:00100000:0.0:1788744679.710701:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451177856 00000100:00100000:0.0:1788744679.710775:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 125 00000100:00100000:0.0:1788744679.710785:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+15:10536:x1875634451177856:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788744679.710842:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744679.710870:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb3927c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55016 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.710909:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93a209e2ea00) 00010000:00010000:0.0:1788744679.710916:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744679.710962:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3927eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.710976:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3927eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.710987:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3927eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744679.711335:0:5840:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000026cbbf87 reply state 00000000c03a2773 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3927eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744679.711345:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788744679.711444:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+16:10536:x1875634451177856:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 659us (956us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788744679.711452:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 125 00010000:00010000:3.0:1788744679.715352:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3927eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.715369:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3927eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.715377:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3927eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.715382:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ec00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744679.715386:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3927eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.715393:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3927eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.715416:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93a209e2ea00) 00010000:00010000:3.0:1788744679.715419:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744679.715424:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3927eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.715431:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb3927eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744679.717335:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744679.718823:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451177984 00000100:00100000:1.0:1788744679.718840:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451177984 00000100:00100000:1.0:1788744679.719417:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:1.0:1788744679.719430:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451177984:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788744679.719721:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788744679.719738:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788744678 -> 1788744677 00002000:00010000:1.0:1788744679.719740:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788744677 00002000:00010000:1.0:1788744679.719743:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788744678 -> 1788744677 00002000:00010000:1.0:1788744679.719753:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788744679.719815:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2359:x1875634451177984:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 389us (2488us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788744679.719824:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:0.0:1788744679.723382:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744679.723828:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451178240 00000100:00100000:2.0:1788744679.723840:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451178240 00000100:00100000:2.0:1788744679.723947:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:2.0:1788744679.723959:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+15:10536:x1875634451178240:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788744679.724050:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3927f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.724072:0:11306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3927ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55008 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.724081:0:11306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3927f2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.724117:0:11306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3927ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55008 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.724183:0:11306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3927ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55008 expref: 15 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744679.724201:0:11306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c131180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475307008:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744679.724308:0:11306:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744679.727800:0:11306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c131180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475307008:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744679.727832:0:11306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3927f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744679.728542:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744679.728668:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451178368 00000100:00100000:3.0:1788744679.728677:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451178368 00010000:00010000:3.0:1788744679.728736:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3927ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55008 expref: 16 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744679.728789:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:3.0:1788744679.728799:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+16:2360:x1875634451178368:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744679.728818:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744679.728826:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3927ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55008 expref: 16 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.728836:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3927ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55008 expref: 16 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.728861:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3927ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55008 expref: 16 pid: 5842 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.728877:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93a209e2ea00) 00010000:00010000:3.0:1788744679.728882:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3927f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.728890:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3927f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.728897:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3927f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.728949:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744679.729009:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+15:2360:x1875634451178368:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 211us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744679.729017:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 58 00010000:00010000:1.0:1788744679.730383:0:11306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3927f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.730399:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3927f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.730434:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3927f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.730441:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3927f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.730449:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3927f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.730455:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744679.730572:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3927f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.730599:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3927f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.730615:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93a209e2ea00) 00010000:00010000:1.0:1788744679.730618:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788744679.730622:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3927f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744679.730627:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3927f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744679.730698:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+14:10536:x1875634451178240:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 Request processed in 6741us (7326us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788744679.730704:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:0.0:1788744679.734946:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744679.735126:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451178496 00000100:00100000:2.0:1788744679.735164:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451178496 00000100:00100000:2.0:1788744679.735229:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:2.0:1788744679.735240:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2359:x1875634451178496:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788744679.735299:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000021e9450c/0x4b162761eb3927f9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.735323:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdc56c40/0x4b162761eb3927d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55024 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.735333:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744679.735338:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744679.735342:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021e9450c/0x4b162761eb3927f9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.735376:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cdc56c40/0x4b162761eb3927d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55024 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.735390:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cdc56c40/0x4b162761eb3927d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55024 expref: 7 pid: 6684 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744679.735426:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c130700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1875634475307136:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744679.735598:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788744679.740299:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c130700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6682:1875634475307136:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744679.740334:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000021e9450c/0x4b162761eb3927f9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744679.741862:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744679.742333:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451178624 00000100:00100000:3.0:1788744679.742342:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451178624 00010000:00010000:3.0:1788744679.742375:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc56c40/0x4b162761eb3927d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55024 expref: 8 pid: 6684 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744679.742422:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:3.0:1788744679.742431:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2360:x1875634451178624:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744679.742446:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744679.743540:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cdc56c40/0x4b162761eb3927d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55024 expref: 8 pid: 6684 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.743558:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cdc56c40/0x4b162761eb3927d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55024 expref: 8 pid: 6684 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.743585:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc56c40/0x4b162761eb3927d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55024 expref: 8 pid: 6684 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.743625:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744679.743629:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744679.743634:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021e9450c/0x4b162761eb3927f9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.743641:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021e9450c/0x4b162761eb3927f9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.744086:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744679.744182:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2360:x1875634451178624:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 1750us (2328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744679.744192:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00010000:00010000:2.0:1788744679.748994:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000021e9450c/0x4b162761eb3927f9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.749018:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021e9450c/0x4b162761eb3927f9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.749058:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000021e9450c/0x4b162761eb3927f9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.749068:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021e9450c/0x4b162761eb3927f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.749078:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021e9450c/0x4b162761eb3927f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.749086:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2c00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744679.749090:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021e9450c/0x4b162761eb3927f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.749099:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021e9450c/0x4b162761eb3927f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.749161:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021e9450c/0x4b162761eb3927f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.749169:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021e9450c/0x4b162761eb3927f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744679.749281:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451178496:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 Request processed in 14038us (14340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744679.749292:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:0.0:1788744679.753156:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744679.753245:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451178880 00000100:00100000:2.0:1788744679.753255:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451178880 00000100:00100000:2.0:1788744679.753313:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 127 00000100:00100000:2.0:1788744679.753323:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+14:10536:x1875634451178880:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788744679.753401:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392800 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.753420:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.753434:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.753680:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392807 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.753693:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3927ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5500f expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.753720:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392807 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.753769:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3927ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5500f expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.753784:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3927ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5500f expref: 15 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744679.753800:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c130000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475307264:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744679.753892:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788744679.772591:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744679.772624:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451179008 00000100:00100000:2.0:1788744679.772633:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451179008 00010000:00010000:2.0:1788744679.772683:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3927ba lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5500f expref: 16 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744679.772720:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:2.0:1788744679.772730:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c130700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+16:2359:x1875634451179008:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744679.772745:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744679.772759:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3927ba lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5500f expref: 16 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.772773:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3927ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5500f expref: 16 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.772814:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93a209e2ea00) 00010000:00010000:2.0:1788744679.772820:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392807 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.772830:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392807 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.772838:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392807 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.772858:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744679.772908:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c130700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+16:2359:x1875634451179008:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 179us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744679.772916:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 60 00010000:00010000:2.0:1788744679.772994:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb3927ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5500f expref: 15 pid: 5841 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744679.773010:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c130000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475307264:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744679.773030:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392807 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.773039:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392807 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.773045:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392807 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744679.773253:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788744679.773406:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788744679.773464:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788744679.773566:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c130000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1875634475307392:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788744679.773619:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744679.773647:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744679.773669:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475307392 00000100:00100000:2.0:1788744679.773674:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475307392 00000100:00100000:2.0:1788744679.773708:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744679.773717:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5842:x1875634475307392:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788744679.773785:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5842:x1875634475307392:12345-0@lo:1000:mdt00_002.0 Request processed in 69us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744679.773792:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744679.773896:0:5842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788744679.773902:0:5842:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:2.0:1788744679.773921:0:5842:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93a23d356d80 x1875634475306624/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788744695 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744679.773931:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c130000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1875634475307392:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788744679.774413:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788744679.774475:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c130000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1875634475307520:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788744679.774520:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744679.774542:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788744679.774556:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475307520 00000100:00100000:2.0:1788744679.774560:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475307520 00000100:00100000:2.0:1788744679.774589:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744679.774597:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5842:x1875634475307520:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788744679.774748:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5842:x1875634475307520:12345-0@lo:1000:mdt00_002.0 Request processed in 150us (227us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788744679.774760:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744679.774811:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c130000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1875634475307520:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788744679.774841:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392807 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.774849:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392807 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.774857:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392807 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.774862:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744679.774867:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392807 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.774873:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392807 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.774887:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93a209e2ea00) 00010000:00010000:2.0:1788744679.774890:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744679.774895:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392807 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.774902:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392807 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.774930:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39274a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.774936:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39274a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.774942:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39274a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.774954:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744679.774957:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39274a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.774963:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39274a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.774972:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:2.0:1788744679.774974:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744679.774981:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392751 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ff3 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.774997:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392751 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ff3 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.775006:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392751 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ff3 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.775035:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392751 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ff3 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744679.775046:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c132a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475307648:192.168.201.6@tcp:105: 00000100:00100000:2.0:1788744679.775105:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788744679.783672:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744679.783718:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451179136 00000100:00100000:3.0:1788744679.783728:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451179136 00000100:00100000:3.0:1788744679.783792:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:3.0:1788744679.783803:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+19:10535:x1875634451179136:12345-192.168.201.6@tcp:49:lfs.0 00000100:00100000:3.0:1788744679.783942:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+19:10535:x1875634451179136:12345-192.168.201.6@tcp:49:lfs.0 Request processed in 139us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744679.783949:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:3.0:1788744679.785253:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c132a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475307648:192.168.201.6@tcp:105: 00010000:00010000:3.0:1788744679.785279:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39274a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785290:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39274a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785329:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb39280e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785342:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb39280e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785352:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb39280e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785361:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb39280e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785367:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb39280e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785374:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb39280e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785379:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200030400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744679.785383:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb39280e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785401:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb39280e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785419:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:3.0:1788744679.785422:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744679.785426:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb39280e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785433:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb39280e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785452:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392800 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785674:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392800 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785692:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392800 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785698:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2e00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744679.785701:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392800 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785707:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392800 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785716:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:3.0:1788744679.785718:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788744679.785721:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392800 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.785726:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392800 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744679.786083:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+18:10536:x1875634451178880:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 32758us (32962us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1788744679.786095:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 127 00000020:00080000:3.0:1788744679.786100:0:5842:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788744679.788016:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788744679.788026:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788744679.789999:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788744679.790015:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744679.796872:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744679.796918:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744679.797000:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451179648 00000100:00100000:3.0:1788744679.797014:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451179648 00000100:00100000:3.0:1788744679.797076:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:3.0:1788744679.797087:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a210e38050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+18:10536:x1875634451179648:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788744679.797160:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451179392 00000100:00100000:0.0:1788744679.797165:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451179392 00000100:00100000:0.0:1788744679.797199:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 128 00000100:00100000:0.0:1788744679.797204:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+19:10535:x1875634451179392:12345-192.168.201.6@tcp:58:lfs.0 00000040:00080000:0.0:1788744679.797520:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788744679.797597:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+20:10535:x1875634451179392:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 390us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744679.797613:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 128 00000004:00080000:3.0:1788744679.801155:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788744679.801303:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788744679.801385:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392815 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.801403:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392815 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.801417:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392815 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.801426:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392815 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.801432:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392815 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.801438:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392815 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744679.801470:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744679.802779:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744679.802797:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392815 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.802809:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200030c00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744679.802814:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392815 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.802823:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392815 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.802839:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93a21a9aea00) 00010000:00010000:0.0:1788744679.802842:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788744679.802848:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392815 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.802854:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392815 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.802877:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744679.802880:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744679.802882:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744679.806611:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a210e38050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+20:10536:x1875634451179648:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 9514us (9680us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788744679.806626:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 32 00000020:00080000:3.0:1788744679.806633:0:5844:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:1.0:1788744679.821465:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1788744679.821491:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788744679.821511:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:2.0:1788744679.853354:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744679.853571:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451179776 00000100:00100000:0.0:1788744679.853583:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451179776 00000100:00100000:0.0:1788744679.853646:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 129 00000100:00100000:0.0:1788744679.853657:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+20:10538:x1875634451179776:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788744679.853682:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744679.853706:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb39281c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5502b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.853806:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392823 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.853824:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392823 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.853836:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392823 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.853850:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39282a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.853856:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39282a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.853862:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39282a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.854108:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392831 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.854119:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fec expref: 21 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.854170:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392831 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.854207:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fec expref: 21 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.854233:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fec expref: 21 pid: 11306 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744679.854248:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a2064b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875634475307776:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788744679.854351:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a202ec3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744679.857506:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744679.857656:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451180032 00000100:00100000:1.0:1788744679.857667:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451180032 00000100:00100000:1.0:1788744679.857741:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:1.0:1788744679.857757:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+22:5599:x1875634451180032:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788744679.858024:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+23:5599:x1875634451180032:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 273us (536us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788744679.858032:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:0.0:1788744679.858447:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a2064b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875634475307776:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788744679.858477:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392831 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744679.861545:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744679.861716:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451180160 00000100:00100000:2.0:1788744679.861726:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451180160 00010000:00010000:2.0:1788744679.861781:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fec expref: 23 pid: 11306 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744679.861846:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:2.0:1788744679.861856:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202e09850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+23:2360:x1875634451180160:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744679.861874:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744679.861881:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fec expref: 23 pid: 11306 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.861895:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fec expref: 23 pid: 11306 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.861919:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb39273c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d54fec expref: 23 pid: 11306 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.861934:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:2.0:1788744679.861940:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392831 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.861949:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.861957:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392831 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744679.861991:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744679.862051:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202e09850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+22:2360:x1875634451180160:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 196us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744679.862060:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 61 00010000:00010000:0.0:1788744679.862839:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.862851:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744679.862898:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788744679.862903:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744679.862925:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.862943:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.862954:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392823 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.862960:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392823 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.862987:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392823 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.862993:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ea00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744679.862997:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392823 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.863007:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392823 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.863022:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:0.0:1788744679.863024:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744679.863030:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392823 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.863035:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392823 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.863049:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39282a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.863055:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39282a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.863060:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39282a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.863064:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744679.863066:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39282a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.863081:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39282a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.863088:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93a203c30000) 00010000:00010000:0.0:1788744679.863090:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744679.863094:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39282a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.863099:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb39282a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.863188:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb39281c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5502b expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.863203:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392831 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5502b expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744679.863210:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:0.0:1788744679.863212:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744679.863214:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17fa00, rc 0) 00000100:00100000:0.0:1788744679.863264:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+21:10538:x1875634451179776:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 9609us (9920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744679.863272:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 129 00000100:00100000:3.0:1788744680.245577:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744680.245617:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475307904:0@lo:400:kworker.0 00000100:00100000:3.0:1788744680.245694:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744680.254772:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744680.254813:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475308032:0@lo:400:kworker.0 00000100:00100000:2.0:1788744680.254882:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744680.254957:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475308032 00000100:00100000:2.0:1788744680.254966:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475308032 00000100:00100000:2.0:1788744680.255022:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788744680.255031:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475308032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744680.255085:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475308032:12345-0@lo:400:kworker.0 Request processed in 55us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744680.255092:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788744680.255158:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475308032:0@lo:400:kworker.0 00000100:00100000:2.0:1788744680.255207:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475308160:0@lo:400:kworker.0 00000100:00100000:2.0:1788744680.255232:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744680.255282:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744680.255288:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634475308288:0@lo:400:kworker.0 00000100:00100000:2.0:1788744680.255313:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744680.257959:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475308160 00000100:00100000:3.0:1788744680.257975:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475308160 00000100:00100000:3.0:1788744680.258059:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475308288 00000100:00100000:3.0:1788744680.258063:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475308288 00000100:00100000:3.0:1788744680.258086:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788744680.258096:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475308160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744680.258196:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475308160:12345-0@lo:400:kworker.0 Request processed in 102us (2962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744680.258204:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788744680.258224:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788744680.258231:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875634475308288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744680.258259:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875634475308288:12345-0@lo:400:kworker.0 Request processed in 29us (2945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744680.258265:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788744680.258321:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475307904 00000100:00100000:3.0:1788744680.258325:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475307904 00000100:00100000:3.0:1788744680.258347:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788744680.258353:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475307904:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788744680.258523:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744680.258572:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634475308288:0@lo:400:kworker.0 00000100:00100000:2.0:1788744680.258588:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475308160:0@lo:400:kworker.0 00000100:00100000:3.0:1788744680.260765:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3308:x1875634475307904:12345-0@lo:400:kworker.0 Request processed in 2400us (15060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744680.260781:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788744680.260878:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475307904:0@lo:400:kworker.0 00010000:00010000:3.0:1788744680.567610:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788744680.740999:0:12058:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788744680.741009:0:12058:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788744680.741052:0:12058:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788744680.741204:0:12058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788744680.759613:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475308416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744680.759690:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744680.763315:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475308416 00000100:00100000:3.0:1788744680.763360:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475308416 00000100:00100000:2.0:1788744680.792958:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788744680.792985:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1875634475308416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744680.793019:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788744680.793196:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1875634475308416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (33436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744680.793217:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788744680.795288:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475308416:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788744680.821341:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788744680.821352:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788744680.821391:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788744680.821396:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788744680.821564:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd82300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875634475308544:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788744680.822848:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c40b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744680.830252:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd82300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875634475308544:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788744680.830586:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744680.831219:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451180288 00000100:00100000:3.0:1788744680.831229:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451180288 00000100:00100000:3.0:1788744680.831283:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 130 00000100:00100000:3.0:1788744680.831292:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+21:10550:x1875634451180288:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788744680.831328:0:5842:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788744680.831444:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+21:10550:x1875634451180288:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 152us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744680.831452:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 130 00000100:00100000:3.0:1788744680.836876:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744680.836926:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451180544 00000100:00100000:3.0:1788744680.836937:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451180544 00000100:00100000:3.0:1788744680.836996:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 131 00000100:00100000:3.0:1788744680.837008:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+21:10550:x1875634451180544:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744680.837032:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744680.837054:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb392838 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55032 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744680.837178:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb39283f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744680.837195:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb39283f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744680.837208:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb39283f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744680.837235:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788744680.837378:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb392838 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55032 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744680.837399:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb39283f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55032 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744680.837407:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:3.0:1788744680.837409:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744680.837413:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a200030800, rc 0) 00000100:00100000:3.0:1788744680.837489:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+23:10550:x1875634451180544:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 470us (612us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788744680.837497:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 131 00000100:00100000:0.0:1788744680.847425:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744680.847525:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744680.847556:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451180672 00000100:00100000:0.0:1788744680.847565:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451180672 00000100:00100000:0.0:1788744680.847624:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:0.0:1788744680.847649:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+23:2359:x1875634451180672:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744680.847683:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744680.847708:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb39283f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55032 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744680.847735:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:0.0:1788744680.847741:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744680.847794:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+22:2359:x1875634451180672:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 148us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744680.847802:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:0.0:1788744680.847827:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451180928 00000100:00100000:0.0:1788744680.847831:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451180928 00000100:00100000:0.0:1788744680.847858:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 132 00000100:00100000:0.0:1788744680.847866:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+22:10550:x1875634451180928:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788744680.847945:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39284d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744680.847960:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39284d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744680.847971:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39284d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744680.848193:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39284d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744680.848202:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39284d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744680.848220:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39284d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744680.848226:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ea00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744680.848230:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39284d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744680.848238:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39284d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744680.848246:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:0.0:1788744680.848250:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788744680.848253:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39284d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744680.848259:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39284d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744680.848376:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+23:10550:x1875634451180928:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 509us (850us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788744680.848384:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 132 00000040:00080000:0.0:1788744680.848588:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744680.848594:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744680.849074:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788744680.849083:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788744680.856211:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744680.856325:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451181184 00000100:00100000:3.0:1788744680.856336:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451181184 00000100:00100000:3.0:1788744680.856427:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:3.0:1788744680.856437:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+23:10550:x1875634451181184:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788744680.856702:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+24:10550:x1875634451181184:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 266us (501us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788744680.856711:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:0.0:1788744680.870047:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744680.870124:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451181312 00000100:00100000:1.0:1788744680.870158:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451181312 00000100:00100000:1.0:1788744680.870216:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 288 00000100:00100000:1.0:1788744680.870226:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2360:x1875634451181312:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744680.870298:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2360:x1875634451181312:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 74us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744680.870306:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 288 00000100:00100000:1.0:1788744680.875095:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744680.875160:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744680.875189:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744680.875219:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451181696 00000100:00100000:1.0:1788744680.875229:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451181696 00000100:00100000:1.0:1788744680.875293:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 138 00000100:00100000:1.0:1788744680.875303:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451181696:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744680.875392:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2359:x1875634451181696:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 89us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744680.875400:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 138 00000100:00100000:1.0:1788744680.875425:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451181440 00000100:00100000:1.0:1788744680.875429:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451181440 00000100:00100000:1.0:1788744680.875453:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451181568 00000100:00100000:1.0:1788744680.875456:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451181568 00000100:00100000:1.0:1788744680.875490:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:1.0:1788744680.875497:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2359:x1875634451181440:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744680.875524:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2359:x1875634451181440:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 28us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744680.875530:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:1.0:1788744680.875545:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00100000:1.0:1788744680.875551:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451181568:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744680.875582:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451181568:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 31us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744680.875589:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00080000:1.0:1788744680.875606:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744680.875612:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744681.269292:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744681.269321:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a2064ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475308672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744681.269404:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744681.270563:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475308672 00000100:00100000:1.0:1788744681.270578:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475308672 00000100:00080000:2.0:1788744681.270837:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744681.272089:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788744681.272113:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475308672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744681.272173:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744681.272273:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475308672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (2870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744681.272297:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788744681.272525:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788744681.272533:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:2.0:1788744681.272558:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93a241d45180, transno 4294967301 00000004:00080000:2.0:1788744681.272565:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1788744681.272577:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93a23cd2e680, transno 4294967304 00000100:00100000:2.0:1788744681.272589:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a2064ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475308672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788744681.588353:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744682.618165:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744682.804046:0:12109:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744682.804056:0:12109:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744682.804108:0:12109:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788744682.804114:0:12109:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788744682.979873:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744682.979959:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451181952 00000100:00100000:3.0:1788744682.979974:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451181952 00000100:00100000:3.0:1788744682.980073:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 133 00000100:00100000:3.0:1788744682.980083:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+24:10571:x1875634451181952:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788744682.980108:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744682.980163:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392854 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55039 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744682.980274:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb39285b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744682.980291:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb39285b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744682.980305:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb39285b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744682.980318:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788744682.980475:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392854 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55039 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744682.980495:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb39285b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55039 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744682.980504:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:3.0:1788744682.980508:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788744682.980511:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a200030400, rc 0) 00000100:00100000:3.0:1788744682.980563:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+26:10571:x1875634451181952:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 481us (706us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788744682.980569:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 133 00000100:00080000:1.0:1788744682.980687:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744682.991933:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744682.992048:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451182080 00000100:00100000:3.0:1788744682.992070:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451182080 00000100:00100000:3.0:1788744682.992170:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 134 00000100:00100000:3.0:1788744682.992181:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+26:10571:x1875634451182080:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:3.0:1788744682.992252:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392869 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744682.992270:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744682.992283:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744682.992312:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744682.992324:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392869 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744682.992332:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744682.992338:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200031a00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744682.992342:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744682.992349:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392869 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744682.992361:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:3.0:1788744682.992364:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744682.992369:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392869 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744682.992386:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392869 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744682.992463:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+26:10571:x1875634451182080:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 282us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744682.992470:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 134 00000100:00100000:3.0:1788744683.127398:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744683.127537:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451182208 00000100:00100000:2.0:1788744683.127547:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451182208 00000100:00100000:2.0:1788744683.127614:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:2.0:1788744683.127626:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2361:x1875634451182208:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:2.0:1788744683.127646:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744683.127668:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005677f89/0x4b162761eb392870 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55040 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744683.127708:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9e13e5, atime: 0x6a9e13e5, ctime: 0x6a9e13e5, blocks: 0xb 00010000:00010000:2.0:1788744683.127729:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1788744683.127734:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744683.127743:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005677f89/0x4b162761eb392870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55040 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744683.127763:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000005677f89/0x4b162761eb392870 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55040 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744683.127805:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3e00, rc 0) 00000100:00100000:2.0:1788744683.127869:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2361:x1875634451182208:12345-192.168.201.6@tcp:101:cat.0 Request processed in 245us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744683.127877:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00080000:3.0:1788744683.128477:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744683.135908:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744683.136444:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451182336 00000100:00100000:3.0:1788744683.136458:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451182336 00002000:00100000:3.0:1788744683.136517:0:6688:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff93a2064ba300 x1875634451182336/t0(0) o3->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:204/0 lens 488/0 e 0 to 0 dl 1788744694 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788744683.136529:0:6688:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a2064ba300 with x1875634451182336 ext(0->4095) 00002000:00010000:3.0:1788744683.136535:0:6688:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93a2064ba300 00000100:00100000:3.0:1788744683.136620:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:3.0:1788744683.136631:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2359:x1875634451182336:12345-192.168.201.6@tcp:3:cat.0 00000100:00100000:3.0:1788744683.137294:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2359:x1875634451182336:12345-192.168.201.6@tcp:3:cat.0 Request processed in 661us (3315us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788744683.137303:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00002000:00100000:3.0:1788744683.137311:0:6688:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff93a2064ba300 x1875634451182336/t0(0) o3->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:204/0 lens 488/4536 e 0 to 0 dl 1788744694 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788744683.137319:0:6688:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a2064ba300 with x1875634451182336 ext(0->4095) 00002000:00010000:3.0:1788744683.137323:0:6688:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93a2064ba300 00010000:00010000:0.0:1788744683.637027:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744684.669884:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788744684.926252:0:11962:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:1.0:1788744684.926270:0:11962:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1788744684.926288:0:11962:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93a204a9f9c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788744684.926294:0:11962:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93a23ccdff00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93a204a9fc00 00000020:00080000:1.0:1788744684.926299:0:11962:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93a23ccdfd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93a105625800 00000001:00080000:1.0:1788744684.926313:0:11962:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1788744684.926383:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788744684.926589:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1788744684.947264:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1788744684.947281:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788744684.947289:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:2.0:1788744685.365410:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475309184:0@lo:400:kworker.0 00000100:00100000:2.0:1788744685.365495:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744685.365560:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744685.365576:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875634475309056:0@lo:400:kworker.0 00000100:00100000:2.0:1788744685.365607:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744685.365641:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475309184 00000100:00100000:2.0:1788744685.365649:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475309184 00000100:00100000:2.0:1788744685.365711:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788744685.365720:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475309184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744685.365771:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475309184:12345-0@lo:400:kworker.0 Request processed in 53us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744685.365778:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788744685.365815:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475309056 00000100:00100000:2.0:1788744685.365819:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475309056 00000100:00100000:2.0:1788744685.365845:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788744685.365851:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875634475309056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744685.365881:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875634475309056:12345-0@lo:400:kworker.0 Request processed in 30us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744685.365886:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1788744685.365902:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744685.365926:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744685.365965:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875634475309056:0@lo:400:kworker.0 00000100:00100000:2.0:1788744685.365977:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475309184:0@lo:400:kworker.0 00000100:00100000:0.0:1788744685.366086:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475308800:0@lo:400:kworker.0 00000100:00100000:0.0:1788744685.366122:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744685.366192:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634475309312:0@lo:400:kworker.0 00000100:00100000:0.0:1788744685.366214:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744685.366233:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788744685.366239:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475308928:0@lo:400:kworker.0 00000100:00100000:0.0:1788744685.366261:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744685.366277:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475309440:0@lo:400:kworker.0 00000100:00100000:0.0:1788744685.366296:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744685.366321:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475309312 00000100:00100000:0.0:1788744685.366325:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475309312 00000100:00100000:0.0:1788744685.366354:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475308928 00000100:00100000:0.0:1788744685.366357:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475308928 00000100:00100000:0.0:1788744685.366372:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788744685.366377:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875634475309312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744685.366424:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875634475309312:12345-0@lo:400:kworker.0 Request processed in 47us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744685.366431:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788744685.366443:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788744685.366456:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475308928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744685.366483:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475308928:12345-0@lo:400:kworker.0 Request processed in 28us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744685.366488:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788744685.366508:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475309440 00000100:00100000:0.0:1788744685.366512:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475309440 00000100:00100000:0.0:1788744685.366538:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788744685.366545:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475309440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744685.366575:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475309440:12345-0@lo:400:kworker.0 Request processed in 31us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744685.366580:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788744685.366596:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744685.366599:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744685.366618:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475308928:0@lo:400:kworker.0 00000100:00100000:0.0:1788744685.366625:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788744685.366630:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93a23d356d80, transno 4294967309 00000004:00080000:0.0:1788744685.366639:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93a23d355500, transno 4294967310 00000004:00080000:0.0:1788744685.366644:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788744685.366663:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475309440:0@lo:400:kworker.0 00000100:00100000:0.0:1788744685.366674:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634475309312:0@lo:400:kworker.0 00000100:00100000:2.0:1788744685.367440:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475308800 00000100:00100000:2.0:1788744685.367450:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475308800 00000100:00100000:2.0:1788744685.367540:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788744685.367549:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3309:x1875634475308800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744685.367611:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3309:x1875634475308800:12345-0@lo:400:kworker.0 Request processed in 64us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744685.367618:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788744685.367705:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475308800:0@lo:400:kworker.0 00010000:00010000:0.0:1788744685.695598:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744685.881827:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475309568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744685.881891:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744685.881952:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475309568 00000100:00100000:0.0:1788744685.881964:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475309568 00000100:00100000:0.0:1788744685.882006:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788744685.882013:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475309568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744685.882044:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744685.882077:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475309568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744685.882081:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788744685.882115:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475309568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744686.007299:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744686.009596:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744686.009650:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744686.009676:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744686.009681:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451182720 00000100:00100000:1.0:1788744686.009700:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451182720 00000100:00100000:2.0:1788744686.009702:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744686.009729:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451182976 00000100:00100000:2.0:1788744686.009732:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451182976 00000100:00100000:3.0:1788744686.012870:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451182464 00000100:00100000:3.0:1788744686.012907:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451182464 00000100:00100000:3.0:1788744686.014077:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 290 00000100:00100000:3.0:1788744686.014089:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2362:x1875634451182464:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744686.014190:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2362:x1875634451182464:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 101us (6899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744686.014198:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 290 00000100:00100000:3.0:1788744686.016593:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451182848 00000100:00100000:3.0:1788744686.016608:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451182848 00000100:00100000:1.0:1788744686.016991:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:1.0:1788744686.017002:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2362:x1875634451182720:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744686.017068:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2362:x1875634451182720:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 69us (7484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744686.017075:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:2.0:1788744686.022037:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451182592 00000100:00100000:2.0:1788744686.022050:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451182592 00000100:00100000:2.0:1788744686.022096:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 142 00000100:00100000:2.0:1788744686.022108:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451182976:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744686.022211:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451182976:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 106us (12560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744686.022218:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 142 00000100:00100000:2.0:1788744686.022242:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 143 00000100:00100000:2.0:1788744686.022249:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+13:2362:x1875634451182592:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744686.022285:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+13:2362:x1875634451182592:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 37us (12608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744686.022292:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 143 00000100:00100000:3.0:1788744686.026375:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:3.0:1788744686.026401:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451182848:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744686.026486:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2362:x1875634451182848:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 100us (16782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744686.026494:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00080000:0.0:1788744686.027109:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744686.027398:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744686.027403:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744686.388783:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c06a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475309696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744686.388860:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744686.389676:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475309696 00000100:00100000:1.0:1788744686.389687:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475309696 00000100:00100000:1.0:1788744686.389748:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788744686.389759:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475309696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744686.389799:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744686.400342:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475309696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10570us (11467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744686.400371:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788744686.400818:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c06a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475309696:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788744686.708319:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744687.028499:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744687.028510:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744687.028605:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788744687.028613:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788744687.734335:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744688.372334:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744688.372480:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451183104 00000100:00100000:1.0:1788744688.372491:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451183104 00000100:00100000:1.0:1788744688.372585:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 135 00000100:00100000:1.0:1788744688.372597:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c06a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+13:10224:x1875634451183104:12345-192.168.201.6@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788744688.372719:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c06a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+13:10224:x1875634451183104:12345-192.168.201.6@tcp:60:lhsmtool_posix.0 Request processed in 125us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744688.372728:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 135 00000100:00080000:0.0:1788744688.372980:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744688.381119:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744688.381644:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451183360 00000100:00100000:1.0:1788744688.381653:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451183360 00000100:00100000:1.0:1788744688.381877:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:1.0:1788744688.381893:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+13:10224:x1875634451183360:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788744688.382308:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+14:10224:x1875634451183360:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 418us (1200us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788744688.386854:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00010000:00010000:3.0:1788744688.759097:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744689.780306:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788744690.071460:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788744690.071474:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1788744690.071488:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788744690.071499:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:0.0:1788744690.217242:0:12310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:31:28 (1788744688) 00000100:00100000:0.0:1788744690.484881:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475310208:0@lo:400:kworker.0 00000100:00100000:0.0:1788744690.484945:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744690.485010:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744690.485016:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875634475310080:0@lo:400:kworker.0 00000100:00100000:0.0:1788744690.485043:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744690.485073:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475310208 00000100:00100000:0.0:1788744690.485079:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475310208 00000100:00100000:0.0:1788744690.485154:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788744690.485164:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475310208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744690.485213:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475310208:12345-0@lo:400:kworker.0 Request processed in 51us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744690.485377:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634475309952:0@lo:400:kworker.0 00000100:00100000:3.0:1788744690.485407:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744690.485426:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475310464:0@lo:400:kworker.0 00000100:00100000:3.0:1788744690.485445:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744690.485466:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788744690.485471:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475309824:0@lo:400:kworker.0 00000100:00100000:3.0:1788744690.485507:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744690.485525:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634475310336:0@lo:400:kworker.0 00000100:00100000:3.0:1788744690.485544:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744690.485683:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475310464 00000100:00100000:1.0:1788744690.485689:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475310464 00000100:00100000:2.0:1788744690.485758:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475310080 00000100:00100000:2.0:1788744690.485762:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475310080 00000100:00100000:2.0:1788744690.485801:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475309952 00000100:00100000:2.0:1788744690.485804:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475309952 00000100:00100000:2.0:1788744690.485817:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475310336 00000100:00100000:2.0:1788744690.485819:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475310336 00000100:00100000:2.0:1788744690.485834:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788744690.485842:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875634475310080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744690.485881:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875634475310080:12345-0@lo:400:kworker.0 Request processed in 40us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744690.485887:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788744690.485908:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788744690.485913:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634475309952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744690.485943:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634475309952:12345-0@lo:400:kworker.0 Request processed in 30us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744690.485949:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788744690.485962:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788744690.485970:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634475310336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744690.485995:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634475310336:12345-0@lo:400:kworker.0 Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744690.486001:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788744690.486035:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475309824 00000100:00100000:2.0:1788744690.486038:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475309824 00000100:00100000:2.0:1788744690.486063:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788744690.486069:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3310:x1875634475309824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744690.486098:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3310:x1875634475309824:12345-0@lo:400:kworker.0 Request processed in 30us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744690.486104:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788744690.486170:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475309824:0@lo:400:kworker.0 00000100:00100000:2.0:1788744690.486183:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634475310336:0@lo:400:kworker.0 00000100:00100000:2.0:1788744690.486192:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634475309952:0@lo:400:kworker.0 00000100:00100000:0.0:1788744690.486307:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1788744690.486342:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744690.486348:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744690.486350:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744690.486375:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875634475310080:0@lo:400:kworker.0 00000100:00100000:0.0:1788744690.486387:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475310208:0@lo:400:kworker.0 00000100:00100000:1.0:1788744690.487706:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788744690.487726:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475310464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744690.487804:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475310464:12345-0@lo:400:kworker.0 Request processed in 88us (2358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744690.487826:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788744690.487924:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475310464:0@lo:400:kworker.0 00010000:00010000:2.0:1788744690.808538:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744690.996479:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475310592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744690.996561:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744690.996886:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475310592 00000100:00100000:0.0:1788744690.996895:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475310592 00000100:00100000:0.0:1788744690.996970:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788744690.996982:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475310592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744690.997022:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744690.997074:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475310592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744690.997081:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788744690.997354:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475310592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744691.114978:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744691.115013:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744691.115035:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744691.115052:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744691.115066:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744691.115241:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451183744 00000100:00100000:2.0:1788744691.115251:0:12018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451183744 00000100:00100000:2.0:1788744691.115362:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451183872 00000100:00100000:2.0:1788744691.115366:0:12018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451183872 00000100:00100000:2.0:1788744691.115391:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:2.0:1788744691.115401:0:12018:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2361:x1875634451183744:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744691.115470:0:12018:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2361:x1875634451183744:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 71us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744691.115475:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:2.0:1788744691.115492:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 83 00000100:00100000:2.0:1788744691.115496:0:12018:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2361:x1875634451183872:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744691.115511:0:12018:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2361:x1875634451183872:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 15us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744691.115527:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 83 00000100:00100000:2.0:1788744691.115628:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451184000 00000100:00100000:2.0:1788744691.115632:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451184000 00000100:00100000:2.0:1788744691.115655:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451183616 00000100:00100000:2.0:1788744691.115658:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451183616 00000100:00100000:2.0:1788744691.115689:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 147 00000100:00100000:2.0:1788744691.115697:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2361:x1875634451184000:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744691.115729:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2361:x1875634451184000:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 34us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744691.115735:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 147 00000100:00100000:2.0:1788744691.115761:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 148 00000100:00100000:2.0:1788744691.115768:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+13:2361:x1875634451183616:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744691.115791:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+13:2361:x1875634451183616:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 26us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744691.115795:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 148 00000100:00100000:1.0:1788744691.117442:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451183488 00000100:00100000:1.0:1788744691.117453:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451183488 00000100:00100000:1.0:1788744691.117507:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 292 00000100:00100000:1.0:1788744691.117514:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2361:x1875634451183488:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744691.117567:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2361:x1875634451183488:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 54us (2599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744691.117572:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 292 00000100:00080000:3.0:1788744691.118158:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744691.118165:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744691.118168:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744691.512228:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744691.512254:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475310720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744691.512341:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744691.512523:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475310720 00000100:00100000:2.0:1788744691.512533:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475310720 00000100:00100000:2.0:1788744691.512590:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788744691.512601:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475310720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744691.512640:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744691.512689:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475310720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744691.512696:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788744691.513377:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475310720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744691.695951:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744691.696031:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451184256 00000100:00100000:0.0:1788744691.696041:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451184256 00000100:00100000:0.0:1788744691.696096:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 136 00000100:00100000:0.0:1788744691.696106:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+13:11283:x1875634451184256:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744691.696230:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744691.696254:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392877 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55047 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.696334:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39287e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.696347:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39287e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.696375:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39287e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.696393:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392885 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.696399:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392885 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.696405:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392885 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.696836:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39288c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.696847:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39288c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.696854:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39288c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744691.696864:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788744691.697006:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39287e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.697014:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39287e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.697022:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39287e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.697028:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ea00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744691.697038:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39287e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.697046:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39287e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.697057:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93a21a9ae600) 00010000:00010000:0.0:1788744691.697059:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744691.697064:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39287e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.697070:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb39287e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.697083:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392885 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.697088:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392885 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.697093:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392885 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.697098:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744691.697100:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392885 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.697106:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392885 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.697112:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93a203c30300) 00010000:00010000:0.0:1788744691.697114:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744691.698100:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392885 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.698114:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392885 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.698972:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392877 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55047 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.698995:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39288c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55047 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744691.699004:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93a203446f00) 00010000:00010000:0.0:1788744691.699007:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744691.699010:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17e400, rc 0) 00000100:00100000:0.0:1788744691.699245:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+15:11283:x1875634451184256:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 3137us (3300us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788744691.699254:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 136 00000100:00100000:3.0:1788744691.704055:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744691.704166:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744691.704249:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451184512 00000100:00100000:2.0:1788744691.704275:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451184512 00000100:00100000:2.0:1788744691.704355:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1788744691.704365:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+15:2362:x1875634451184512:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744691.704382:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744691.704408:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb39288c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55047 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744691.704428:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93a203446f00) 00010000:00010000:2.0:1788744691.704433:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744691.704498:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+14:2362:x1875634451184512:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 135us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744691.704506:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:0.0:1788744691.708022:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451184384 00000100:00100000:0.0:1788744691.708041:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451184384 00000100:00100000:0.0:1788744691.708156:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 137 00000100:00100000:0.0:1788744691.708169:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+14:11283:x1875634451184384:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788744691.708305:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+14:11283:x1875634451184384:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 Request processed in 138us (4263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744691.708312:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 137 00010000:00010000:3.0:1788744691.828543:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788744692.156849:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744692.156864:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744692.158841:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788744692.158859:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788744692.861696:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744693.794306:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744693.799269:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451184640 00000100:00100000:3.0:1788744693.799283:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451184640 00000100:00080000:3.0:1788744693.803285:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744693.803328:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 138 00000100:00100000:2.0:1788744693.803342:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+14:11325:x1875634451184640:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744693.803363:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744693.803384:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb39289a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5504e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803462:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3928a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803476:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3928a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803497:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3928a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803645:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803653:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803661:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803904:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3928a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803913:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3928a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803920:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3928a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803926:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744693.803931:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3928a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803938:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3928a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803950:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae400) 00010000:00010000:2.0:1788744693.803953:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744693.803958:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3928a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803970:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb3928a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803981:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803986:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803992:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.803996:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744693.804000:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.804006:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.804013:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93a209e2e100) 00010000:00010000:2.0:1788744693.804015:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744693.804018:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.804024:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.804057:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb39289a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5504e expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.804078:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae400) 00010000:00010000:2.0:1788744693.804081:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744693.804085:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb39289a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5504e expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.804095:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3600, rc 0) 00000100:00100000:2.0:1788744693.804666:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+14:11325:x1875634451184640:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1326us (10368us total) trans 0 rc 301/301 00000100:00100000:2.0:1788744693.804675:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 138 00000100:00100000:1.0:1788744693.811653:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744693.816280:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451184896 00000100:00100000:2.0:1788744693.816297:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451184896 00000100:00100000:2.0:1788744693.816446:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 139 00000100:00100000:2.0:1788744693.816458:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+14:11325:x1875634451184896:12345-192.168.201.6@tcp:36:lfs.0 00010000:00010000:2.0:1788744693.817492:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744693.817534:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a201472200/0x4b162761eb392226 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e8e expref: 14 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.817559:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae400) 00010000:00010000:2.0:1788744693.817571:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744693.817785:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3928af lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.817800:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3928af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.817810:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3928af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.817833:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928b6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.817841:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.817847:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744693.820939:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788744693.820959:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3928af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.820970:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3928af lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.820978:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3928af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.820983:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744693.820988:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3928af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.820995:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3928af lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.821011:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a209e2e100) 00010000:00010000:2.0:1788744693.821014:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744693.821019:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3928af lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.821037:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb3928af lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744693.821056:0:5842:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000009c467861 reply state 00000000e38e2b0d transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744693.821065:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744693.821474:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+15:11325:x1875634451184896:12345-192.168.201.6@tcp:36:lfs.0 Request processed in 5013us (9824us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788744693.821483:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 139 00010000:00010000:3.0:1788744693.823847:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.823863:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928b6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.823871:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928b6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.823878:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744693.823883:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928b6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.823904:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928b6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.823919:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93a209e2e400) 00010000:00010000:3.0:1788744693.823922:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744693.823926:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928b6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.823932:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb3928b6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.880651:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744693.882530:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744693.882565:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451185024 00000100:00100000:3.0:1788744693.882574:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451185024 00000100:00100000:3.0:1788744693.882619:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 140 00000100:00100000:3.0:1788744693.882629:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+14:11333:x1875634451185024:12345-192.168.201.6@tcp:101:lctl.0 00010000:00010000:3.0:1788744693.882654:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744693.882676:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb3928bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55055 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.882741:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031800/0x4b162761eb3928c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.882754:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031800/0x4b162761eb3928c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.882765:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031800/0x4b162761eb3928c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744693.882814:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788744693.882818:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744693.882839:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031800/0x4b162761eb3928c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.882862:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb3928bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55055 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.882879:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031800/0x4b162761eb3928c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55055 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.882887:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae700) 00010000:00010000:3.0:1788744693.882889:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744693.882894:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a200031800, rc 0) 00000100:00100000:3.0:1788744693.882945:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+15:11333:x1875634451185024:12345-192.168.201.6@tcp:101:lctl.0 Request processed in 318us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744693.882953:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 140 00000100:00100000:0.0:1788744693.935602:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744693.935676:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451185152 00000100:00100000:3.0:1788744693.935686:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451185152 00000100:00100000:3.0:1788744693.935747:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 141 00000100:00100000:3.0:1788744693.935758:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+15:11339:x1875634451185152:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788744693.935780:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744693.935802:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb3928cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5505c expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.935880:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb3928d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.935913:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb3928d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.935926:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb3928d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.935940:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb3928d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.935948:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb3928d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.935954:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb3928d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936042:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030000/0x4b162761eb3928e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936366:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030000/0x4b162761eb3928e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936374:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030000/0x4b162761eb3928e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744693.936404:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788744693.936407:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744693.936426:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030000/0x4b162761eb3928e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936437:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb3928d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936454:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb3928d2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936462:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb3928d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936468:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200031a00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744693.936472:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb3928d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936479:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb3928d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936493:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae700) 00010000:00010000:3.0:1788744693.936497:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744693.936502:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb3928d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936508:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb3928d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936522:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb3928d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936527:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb3928d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936533:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb3928d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936537:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200030c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744693.936546:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb3928d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936553:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb3928d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936560:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93a21a9ae000) 00010000:00010000:3.0:1788744693.936563:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744693.936566:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb3928d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936571:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb3928d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936603:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb3928cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5505c expref: 17 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936616:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030000/0x4b162761eb3928e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5505c expref: 16 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.936623:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744693.936625:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788744693.936628:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a200030000, rc 0) 00000100:00100000:3.0:1788744693.936731:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+16:11339:x1875634451185152:12345-192.168.201.6@tcp:101:bash.0 Request processed in 974us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744693.936738:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 141 00000100:00100000:3.0:1788744693.942352:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744693.942729:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451185408 00000100:00100000:1.0:1788744693.942742:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451185408 00000100:00100000:1.0:1788744693.942809:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 142 00000100:00100000:1.0:1788744693.942821:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+16:11339:x1875634451185408:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1788744693.942845:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744693.943456:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb3928e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55063 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.943594:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3928ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.943630:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3928ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.943642:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3928ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.943687:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb3928f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.943694:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb3928f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.943700:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb3928f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788744693.944749:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788744693.944932:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb3928fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.944945:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb3928fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.944955:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb3928fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.944992:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3928ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.944998:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3928ee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.945004:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3928ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.945018:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744693.945023:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3928ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.945031:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3928ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.945044:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:1.0:1788744693.945350:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744693.945357:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3928ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.945364:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3928ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744693.945381:0:5840:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000098d93504 reply state 0000000053119cf9 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb3928f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744693.945392:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788744693.945436:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb3928e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55063 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.945451:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb3928fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55063 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744693.945458:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a203446200) 00010000:00010000:1.0:1788744693.945460:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744693.945463:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051a600, rc 0) 00000100:00100000:1.0:1788744693.945612:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+19:11339:x1875634451185408:12345-192.168.201.6@tcp:101:bash.0 Request processed in 2792us (3271us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788744693.945631:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 142 00010000:00010000:3.0:1788744693.952582:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb3928f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.952624:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb3928f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.952632:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb3928f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.952639:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744693.952703:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb3928f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.952714:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb3928f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.952733:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a203446c00) 00010000:00010000:3.0:1788744693.952736:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744693.952741:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb3928f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.952747:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb3928f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744693.957387:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744693.957459:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451185536 00000100:00100000:2.0:1788744693.957470:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451185536 00000100:00100000:2.0:1788744693.957551:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:2.0:1788744693.957561:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2359:x1875634451185536:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788744693.957582:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744693.957604:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033efbeea/0x4b162761eb39290a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5506a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744693.957633:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744693.957654:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1788744693.957659:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744693.957669:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033efbeea/0x4b162761eb39290a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5506a expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.957690:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033efbeea/0x4b162761eb39290a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5506a expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744693.957725:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3600, rc 0) 00000100:00100000:2.0:1788744693.957800:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451185536:12345-192.168.201.6@tcp:101:bash.0 Request processed in 240us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744693.957809:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00080000:3.0:1788744693.957820:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744693.963523:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744693.963603:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451185664 00000100:00100000:3.0:1788744693.963613:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451185664 00000100:00100000:3.0:1788744693.963662:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:3.0:1788744693.963672:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:11339:x1875634451185664:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788744693.963690:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744693.963710:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55071 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.963759:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000033efbeea/0x4b162761eb39290a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5506a expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.963770:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744693.963774:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744693.963780:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55071 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.963812:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000033efbeea/0x4b162761eb39290a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5506a expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.963826:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000033efbeea/0x4b162761eb39290a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5506a expref: 7 pid: 6685 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744693.963840:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1875634475310848:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788744693.964005:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c40ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744693.969026:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1875634475310848:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744693.969066:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55071 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744693.969088:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a200030800, rc 0) 00000100:00100000:3.0:1788744693.969195:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+7:11339:x1875634451185664:12345-192.168.201.6@tcp:101:bash.0 Request processed in 5524us (5692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744693.969204:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:2.0:1788744693.970667:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744693.973213:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451185792 00000100:00100000:0.0:1788744693.973228:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451185792 00010000:00010000:0.0:1788744693.973308:0:7626:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000033efbeea/0x4b162761eb39290a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5506a expref: 7 pid: 6685 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744693.973367:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:0.0:1788744693.973379:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2360:x1875634451185792:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744693.973399:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744693.973424:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000033efbeea/0x4b162761eb39290a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5506a expref: 7 pid: 6685 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744693.973438:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000033efbeea/0x4b162761eb39290a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5506a expref: 7 pid: 6685 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744693.973467:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033efbeea/0x4b162761eb39290a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5506a expref: 7 pid: 6685 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744693.973487:0:7626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744693.973491:0:7626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744693.973499:0:7626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55071 expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744693.973509:0:7626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55071 expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744693.973550:0:7626:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55071 expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744693.973577:0:7626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d114e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7626:1875634475310976:192.168.201.6@tcp:105: 00000100:00100000:0.0:1788744693.975398:0:7626:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204c06b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744693.982312:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744693.982397:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451186048 00000100:00100000:3.0:1788744693.982409:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451186048 00000100:00100000:3.0:1788744693.982487:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:3.0:1788744693.982506:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+18:11339:x1875634451186048:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:3.0:1788744693.983352:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+19:11339:x1875634451186048:12345-192.168.201.6@tcp:35:bash.0 Request processed in 850us (1046us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788744693.983363:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:0.0:1788744693.984259:0:7626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d114e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7626:1875634475310976:192.168.201.6@tcp:105: 00010000:00010000:0.0:1788744693.984292:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744693.984377:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2360:x1875634451185792:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 11000us (13720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744693.984387:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:1.0:1788744694.095934:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744694.096017:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451186304 00000100:00100000:2.0:1788744694.096028:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451186304 00000100:00100000:2.0:1788744694.096085:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 143 00000100:00100000:2.0:1788744694.096096:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+19:11349:x1875634451186304:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744694.096123:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744694.096183:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392918 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55078 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744694.096302:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788744694.096451:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392918 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55078 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.096466:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae700) 00010000:00010000:2.0:1788744694.096470:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744694.096474:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392918 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55078 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.096490:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2e00, rc 0) 00000100:00100000:2.0:1788744694.096550:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+20:11349:x1875634451186304:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 456us (627us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788744694.096574:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 143 00000100:00100000:2.0:1788744694.099403:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744694.100020:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451186560 00000100:00100000:3.0:1788744694.100030:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451186560 00000100:00100000:3.0:1788744694.100388:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:3.0:1788744694.100401:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+20:11349:x1875634451186560:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1788744694.100882:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+21:11349:x1875634451186560:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 483us (1487us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788744694.100891:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:3.0:1788744694.176833:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744694.176964:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451186688 00000100:00100000:2.0:1788744694.176976:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451186688 00000100:00100000:2.0:1788744694.177053:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 144 00000100:00100000:2.0:1788744694.177067:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+21:11355:x1875634451186688:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744694.177097:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744694.177284:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392926 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5507f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.177359:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39292d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.177374:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39292d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.177388:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39292d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744694.177424:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788744694.177427:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744694.177456:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39292d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.177481:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5507f expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.177508:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39292d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5507f expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.177535:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:2.0:1788744694.177538:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744694.177542:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2c00, rc 0) 00000100:00100000:2.0:1788744694.177676:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+22:11355:x1875634451186688:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 612us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744694.177684:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 144 00000100:00100000:1.0:1788744694.182899:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744694.183421:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451186944 00000100:00100000:3.0:1788744694.183557:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451186944 00000100:00100000:3.0:1788744694.183655:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 145 00000100:00100000:3.0:1788744694.183667:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+22:11355:x1875634451186944:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788744694.183688:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744694.183711:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392934 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55086 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.183818:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb39293b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.183832:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb39293b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.183862:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb39293b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744694.183875:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788744694.184082:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392934 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55086 expref: 25 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.184101:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb39293b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55086 expref: 24 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.184108:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a203446200) 00010000:00010000:3.0:1788744694.184111:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744694.184114:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a200031a00, rc 0) 00000100:00100000:3.0:1788744694.184344:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+24:11355:x1875634451186944:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 678us (1454us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788744694.184352:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 145 00000100:00100000:0.0:1788744694.187880:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744694.188513:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451187200 00000100:00100000:3.0:1788744694.188525:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451187200 00000100:00100000:0.0:1788744694.188753:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744694.188895:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451187328 00000100:00100000:1.0:1788744694.188900:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451187328 00000100:00100000:1.0:1788744694.188951:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 146 00000100:00100000:1.0:1788744694.188964:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+25:11355:x1875634451187328:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788744694.188989:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744694.189011:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392949 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5508d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.189104:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392950 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.189118:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392950 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.189157:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392950 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744694.189170:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788744694.189480:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392949 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5508d expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.189510:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392950 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5508d expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.189539:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a203446200) 00010000:00010000:1.0:1788744694.189542:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788744694.189546:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051a200, rc 0) 00000100:00100000:1.0:1788744694.189655:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+27:11355:x1875634451187328:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 693us (902us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788744694.189663:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 146 00000100:00100000:3.0:1788744694.189863:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:3.0:1788744694.189874:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d114e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+26:2359:x1875634451187200:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744694.189887:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744694.189902:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb39293b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55086 expref: 26 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.189914:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a203446200) 00010000:00010000:3.0:1788744694.189917:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744694.189943:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d114e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+25:2359:x1875634451187200:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 73us (2075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744694.189950:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:1.0:1788744694.207521:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744694.207634:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451187456 00000100:00100000:3.0:1788744694.207644:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451187456 00000100:00100000:3.0:1788744694.207703:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:3.0:1788744694.207714:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2360:x1875634451187456:12345-192.168.201.6@tcp:1:lfs.0 00010000:00010000:3.0:1788744694.207759:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080c0ef29/0x4b162761eb39295e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.207779:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55071 expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.207787:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744694.207792:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744694.207796:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080c0ef29/0x4b162761eb39295e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.207829:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55071 expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.207844:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55071 expref: 6 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744694.207859:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1875634475311104:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788744694.207939:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c40b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788744694.209910:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6682:1875634475311104:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744694.209935:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000080c0ef29/0x4b162761eb39295e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744694.211436:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744694.211947:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451187584 00000100:00100000:2.0:1788744694.211956:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451187584 00002000:00100000:2.0:1788744694.212007:0:6689:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93a23cd80380 x1875634451187584/t0(0) o4->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:215/0 lens 504/0 e 0 to 0 dl 1788744705 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744694.212018:0:6689:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a23cd80380 with x1875634451187584 ext(0->12) 00010000:00010000:2.0:1788744694.212027:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55071 expref: 7 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.212045:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55071 expref: 7 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744694.212053:0:6689:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93a23cd80380 00000100:00100000:2.0:1788744694.212087:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:2.0:1788744694.212097:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2359:x1875634451187584:12345-192.168.201.6@tcp:4:lfs.0 00000100:00100000:2.0:1788744694.212916:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2359:x1875634451187584:12345-192.168.201.6@tcp:4:lfs.0 Request processed in 817us (1490us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788744694.212927:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00002000:00100000:2.0:1788744694.212935:0:6689:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93a23cd80380 x1875634451187584/t4294967305(0) o4->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:215/0 lens 504/448 e 0 to 0 dl 1788744705 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744694.212951:0:6689:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a23cd80380 with x1875634451187584 ext(0->12) 00010000:00010000:2.0:1788744694.212960:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55071 expref: 9 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.212975:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55071 expref: 9 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744694.212982:0:6689:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93a23cd80380 00000100:00100000:3.0:1788744694.216254:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744694.216344:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451187712 00000100:00100000:2.0:1788744694.216355:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451187712 00010000:00010000:2.0:1788744694.216396:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55071 expref: 9 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744694.216447:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:2.0:1788744694.216457:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2360:x1875634451187712:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744694.216471:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788744694.216489:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788744694.216492:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788744693 00002000:00010000:2.0:1788744694.216494:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788744693 00002000:00010000:2.0:1788744694.216507:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788744693 00010000:00010000:2.0:1788744694.216514:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55071 expref: 9 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.216528:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55071 expref: 9 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.216563:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094e430e4/0x4b162761eb392911 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55071 expref: 9 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.216579:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744694.216584:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744694.216589:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000080c0ef29/0x4b162761eb39295e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.216598:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080c0ef29/0x4b162761eb39295e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.216633:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744694.216688:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2360:x1875634451187712:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 232us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744694.216696:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 63 00010000:00010000:3.0:1788744694.216844:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000080c0ef29/0x4b162761eb39295e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.216854:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080c0ef29/0x4b162761eb39295e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.216877:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080c0ef29/0x4b162761eb39295e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.216886:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080c0ef29/0x4b162761eb39295e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.216894:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080c0ef29/0x4b162761eb39295e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.216901:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200030c00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744694.216906:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080c0ef29/0x4b162761eb39295e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.216915:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080c0ef29/0x4b162761eb39295e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.216929:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080c0ef29/0x4b162761eb39295e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.216937:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080c0ef29/0x4b162761eb39295e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744694.216994:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2360:x1875634451187456:12345-192.168.201.6@tcp:1:lfs.0 Request processed in 9282us (9494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744694.217002:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:0.0:1788744694.220054:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744694.220168:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451187968 00000100:00100000:1.0:1788744694.220179:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451187968 00000100:00100000:1.0:1788744694.220234:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:1.0:1788744694.220256:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a210e38450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+25:11355:x1875634451187968:12345-192.168.201.6@tcp:35:lfs.0 00000004:00010000:1.0:1788744694.220326:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392950 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5508d expref: 25 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744694.220633:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1788744694.220682:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788744694.221241:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788744694.221306:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392965 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.221323:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb3928fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55063 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.221339:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392965 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.221374:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb3928fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55063 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.221390:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb3928fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55063 expref: 29 pid: 5840 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744694.221405:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd83480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1875634475311232:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744694.221496:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788744694.225340:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744694.225438:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451188096 00000100:00100000:3.0:1788744694.225448:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451188096 00010000:00010000:3.0:1788744694.225490:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb3928fc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55063 expref: 30 pid: 5840 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744694.225541:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:3.0:1788744694.225552:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d116d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+30:2359:x1875634451188096:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744694.225570:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744694.225578:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb3928fc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55063 expref: 30 pid: 5840 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.225593:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb3928fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55063 expref: 30 pid: 5840 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.225616:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a203446200) 00010000:00010000:3.0:1788744694.225621:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392965 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.225631:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392965 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.225638:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392965 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.225675:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744694.225738:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d116d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+30:2359:x1875634451188096:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 187us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744694.225745:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 64 00010000:00010000:1.0:1788744694.226992:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb3928fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55063 expref: 29 pid: 5840 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744694.227016:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd83480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1875634475311232:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744694.227043:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392965 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.227052:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392965 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.227058:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392965 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744694.227269:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788744694.227491:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1788744694.227623:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd83480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875634475311360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788744694.227715:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744694.227930:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744694.228441:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475311360 00000100:00100000:2.0:1788744694.228451:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475311360 00000100:00100000:2.0:1788744694.228570:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744694.228581:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875634475311360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788744694.228689:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875634475311360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 108us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744694.228697:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788744694.228763:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744694.228933:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd83480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875634475311360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788744694.229535:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1788744694.229618:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd83480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875634475311488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788744694.229661:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744694.230528:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788744694.230719:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475311488 00000100:00100000:0.0:1788744694.230729:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475311488 00000100:00100000:0.0:1788744694.230774:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788744694.230782:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1875634475311488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788744694.231009:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1875634475311488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 227us (1347us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788744694.231017:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744694.231109:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd83480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875634475311488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788744694.231358:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1788744694.231405:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392965 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.231416:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392965 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.231423:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392965 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.231553:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051bc00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744694.231561:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392965 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.231570:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392965 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.231585:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a203446200) 00010000:00010000:1.0:1788744694.231589:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788744694.231593:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392965 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.231616:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392965 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788744694.231788:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788744694.231886:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1788744694.231897:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396930766533ns, next at 397930764141ns, rc = 0 00000001:00080000:1.0:1788744694.231903:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788744694.231936:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a203446200) 00010000:00010000:1.0:1788744694.231940:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788744694.231947:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392950 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5508d expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744694.232093:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a210e38450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11355:x1875634451187968:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 11849us (12048us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1788744694.232102:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00000020:00080000:1.0:1788744694.232106:0:5844:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788744694.234992:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744694.235054:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451188224 00000100:00100000:3.0:1788744694.235066:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451188224 00000100:00100000:3.0:1788744694.235153:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 147 00000100:00100000:3.0:1788744694.235164:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11355:x1875634451188224:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788744694.235190:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744694.235215:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb39296c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55094 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.235287:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb39296c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55094 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.235303:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb39296c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55094 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.235322:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744694.235325:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744694.235329:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a200030c00, rc 0) 00000100:00100000:3.0:1788744694.235606:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+33:11355:x1875634451188224:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 443us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744694.235614:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 147 00000100:00100000:2.0:1788744694.238760:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744694.238871:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451188480 00000100:00100000:3.0:1788744694.238898:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451188480 00000100:00100000:3.0:1788744694.239002:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:3.0:1788744694.239014:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+33:11355:x1875634451188480:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1788744694.239325:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+34:11355:x1875634451188480:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 313us (576us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1788744694.239334:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:2.0:1788744694.328620:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744694.328734:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451188736 00000100:00100000:3.0:1788744694.328745:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451188736 00000100:00100000:3.0:1788744694.328809:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 148 00000100:00100000:3.0:1788744694.328820:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+34:11365:x1875634451188736:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788744694.328846:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744694.328868:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392973 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5509b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744694.328961:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788744694.329083:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392973 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5509b expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.329098:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae700) 00010000:00010000:3.0:1788744694.329101:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744694.329106:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5509b expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.329122:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a200031a00, rc 0) 00000100:00100000:3.0:1788744694.329253:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+35:11365:x1875634451188736:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 425us (633us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788744694.329260:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 148 00000100:00100000:0.0:1788744694.341671:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744694.342565:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451188864 00000100:00100000:1.0:1788744694.342576:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451188864 00000100:00100000:1.0:1788744694.342692:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 149 00000100:00100000:1.0:1788744694.342702:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+35:11365:x1875634451188864:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:1.0:1788744694.342783:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392981 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.342800:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392981 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.342813:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392981 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.342845:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392988 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.342858:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.342866:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.342965:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39298f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.342974:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39298f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.342981:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39298f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744694.343032:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39298f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343046:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392981 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343052:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392981 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343059:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392981 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343065:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744694.343070:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392981 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343084:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392981 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343096:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:1.0:1788744694.343099:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744694.343105:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392981 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343111:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392981 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343175:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343181:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392988 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343186:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343191:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051bc00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744694.343194:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343200:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392988 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343207:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a203446200) 00010000:00010000:1.0:1788744694.343209:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744694.343212:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392988 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343228:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392988 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343252:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39298f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343259:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39298f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343264:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39298f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343270:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744694.343273:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39298f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343278:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39298f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343286:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:1.0:1788744694.343288:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744694.343291:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39298f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.343296:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb39298f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744694.343383:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+35:11365:x1875634451188864:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 682us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744694.343391:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 149 00000100:00100000:0.0:1788744694.346678:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744694.346774:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451189120 00000100:00100000:1.0:1788744694.346786:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451189120 00000100:00100000:1.0:1788744694.346880:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:1.0:1788744694.346891:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+35:11365:x1875634451189120:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788744694.347675:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+36:11365:x1875634451189120:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 784us (1004us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788744694.347685:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:0.0:1788744694.391270:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744694.391438:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451189376 00000100:00100000:3.0:1788744694.391450:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451189376 00000100:00100000:3.0:1788744694.391522:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 150 00000100:00100000:3.0:1788744694.391532:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+36:11368:x1875634451189376:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788744694.391563:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744694.391589:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392996 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d550a2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.391671:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39299d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.391686:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39299d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.391699:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39299d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.391716:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb3929a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.391722:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb3929a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.391728:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb3929a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.391848:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.391857:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.391882:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744694.391893:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788744694.392004:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39299d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.392012:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39299d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.392019:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39299d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.392025:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200031e00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744694.392030:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39299d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.392037:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39299d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.392048:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744694.392051:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744694.392056:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39299d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.392062:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb39299d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.392078:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb3929a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.392084:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb3929a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.392098:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb3929a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.392104:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200030800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744694.392107:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb3929a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.392114:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb3929a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.392122:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a21a9ae400) 00010000:00010000:3.0:1788744694.392549:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744694.392554:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb3929a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.392559:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb3929a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.392619:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392996 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550a2 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.392634:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550a2 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.392641:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744694.392643:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744694.392646:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81400, rc 0) 00000100:00100000:3.0:1788744694.392707:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+38:11368:x1875634451189376:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1176us (1452us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788744694.392724:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 150 00000100:00100000:0.0:1788744694.397357:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744694.397447:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451189504 00000100:00100000:3.0:1788744694.397458:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451189504 00000100:00100000:3.0:1788744694.397533:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 151 00000100:00100000:3.0:1788744694.397547:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+38:11368:x1875634451189504:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:3.0:1788744694.397650:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3929b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.397676:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3929b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.397693:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3929b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.397732:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3929b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.397741:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3929b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.397750:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3929b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.397757:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744694.397762:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3929b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.397770:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3929b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.397784:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744694.397803:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744694.397810:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3929b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.397816:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3929b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744694.397894:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+38:11368:x1875634451189504:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 350us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744694.397901:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 151 00000100:00100000:0.0:1788744694.403720:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744694.403804:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451189760 00000100:00100000:3.0:1788744694.403814:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451189760 00000100:00100000:3.0:1788744694.403870:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:3.0:1788744694.403880:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+38:11368:x1875634451189760:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1788744694.404293:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+39:11368:x1875634451189760:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 413us (582us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788744694.404302:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:0.0:1788744694.669411:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744694.669555:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451190016 00000100:00100000:1.0:1788744694.669572:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451190016 00000100:00100000:1.0:1788744694.669652:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 152 00000100:00100000:1.0:1788744694.669664:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+39:11399:x1875634451190016:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:1.0:1788744694.669695:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744694.669720:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb3929c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d550a9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.670035:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb3929c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.670056:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb3929c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.670070:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb3929c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744694.670085:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788744694.670599:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb3929c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550a9 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.670622:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb3929c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550a9 expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744694.670646:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:1.0:1788744694.670649:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744694.670653:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051bc00, rc 0) 00000100:00100000:1.0:1788744694.670722:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+41:11399:x1875634451190016:12345-192.168.201.6@tcp:101:cat.0 Request processed in 1059us (1486us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788744694.670730:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 152 00000100:00100000:0.0:1788744694.679024:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744694.679087:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744694.679204:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451190144 00000100:00100000:2.0:1788744694.679214:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451190144 00000100:00100000:2.0:1788744694.679317:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:2.0:1788744694.679329:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20d762c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+41:2361:x1875634451190144:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744694.679345:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744694.679370:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb3929c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550a9 expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.679390:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:2.0:1788744694.679395:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744694.679460:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20d762c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+40:2361:x1875634451190144:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 133us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744694.679467:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:1.0:1788744694.681595:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451190400 00000100:00100000:1.0:1788744694.681615:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451190400 00000100:00100000:1.0:1788744694.683615:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:1.0:1788744694.683637:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+40:11399:x1875634451190400:12345-192.168.201.6@tcp:35:cat.0 00000100:00100000:1.0:1788744694.684049:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+41:11399:x1875634451190400:12345-192.168.201.6@tcp:35:cat.0 Request processed in 421us (4960us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788744694.684057:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:2.0:1788744694.797586:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744694.797667:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451190656 00000100:00100000:3.0:1788744694.797678:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451190656 00000100:00100000:3.0:1788744694.797741:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 153 00000100:00100000:3.0:1788744694.797752:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+41:11405:x1875634451190656:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:3.0:1788744694.797777:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744694.797780:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788744694.797805:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39292d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5507f expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.797825:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744694.797829:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744694.797868:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3929d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d550b0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.797965:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3929dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.797979:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550a2 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.797988:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3929dc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.798021:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550a2 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.798036:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550a2 expref: 41 pid: 5841 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744694.798050:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c079c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475311616:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788744694.798210:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c40b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744694.801659:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c079c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475311616:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744694.801688:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3929dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744694.803110:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744694.803688:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451190784 00000100:00100000:3.0:1788744694.803698:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451190784 00010000:00010000:3.0:1788744694.803738:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550a2 expref: 42 pid: 5841 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744694.803782:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:3.0:1788744694.803808:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+42:2360:x1875634451190784:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744694.803826:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744694.803844:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550a2 expref: 42 pid: 5841 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.803858:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550a2 expref: 42 pid: 5841 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.803879:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550a2 expref: 42 pid: 5841 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.803897:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744694.803902:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3929dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.803912:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3929dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.803921:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3929dc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.803956:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744694.804019:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+41:2360:x1875634451190784:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 213us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744694.804026:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 65 00010000:00010000:2.0:1788744694.804161:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3929dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.804170:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3929dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744694.804200:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788744694.804396:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb3929d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550b0 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.804416:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3929dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550b0 expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.804437:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:2.0:1788744694.804448:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788744694.804451:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80800, rc 0) 00000100:00100000:2.0:1788744694.804479:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+41:11405:x1875634451190656:12345-192.168.201.6@tcp:101:dd.0 Request processed in 6729us (6994us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788744694.804485:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 153 00000100:00100000:0.0:1788744694.824373:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744694.824649:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451191040 00000100:00100000:3.0:1788744694.824659:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451191040 00000100:00100000:3.0:1788744694.824728:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 154 00000100:00100000:3.0:1788744694.824737:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+41:11405:x1875634451191040:12345-192.168.201.6@tcp:36:dd.0 00010000:00010000:3.0:1788744694.825048:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.825067:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.825079:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744694.825170:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1788744694.825205:0:5841:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000008fbb8615 reply state 00000000ce64b5e8 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744694.825215:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744694.825634:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+44:11405:x1875634451191040:12345-192.168.201.6@tcp:36:dd.0 Request processed in 895us (1269us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788744694.825642:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 154 00000020:00080000:3.0:1788744694.825648:0:5841:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788744694.830535:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.830556:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.830566:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.830574:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744694.830579:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.830589:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.830629:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744694.830633:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744694.830638:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744694.830645:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb3929ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744694.900657:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788744695.169968:0:11963:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000001:00080000:2.0:1788744695.169990:0:11963:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967438 is committed 00000004:00080000:2.0:1788744695.170003:0:11963:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788744695.170021:0:11963:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93a1070a40c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788744695.170026:0:11963:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93a104bb1b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93a1070a4780 00000020:00080000:2.0:1788744695.170031:0:11963:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93a104bb1200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93a23d165000 00000001:00080000:2.0:1788744695.170061:0:11963:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000001:00080000:2.0:1788744695.170072:0:11963:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000020:00080000:2.0:1788744695.170216:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788744695.170410:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788744695.171376:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744695.171396:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c079c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475311744:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788744695.171458:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744695.171599:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475311744 00000100:00100000:3.0:1788744695.171606:0:12018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475311744 00000100:00100000:3.0:1788744695.172274:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788744695.172286:0:12018:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634475311744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788744695.172318:0:12018:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1788744695.172356:0:12018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9e13f5, atime: 0x6a9e13f5, ctime: 0x6a9e13f5, blocks: 0xb 00010000:00010000:3.0:1788744695.172364:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013483af5/0x4b162761eb3929f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.172381:0:12018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=397s v=(0 0) 00010000:00010000:3.0:1788744695.172386:0:12018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744695.172393:0:12018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013483af5/0x4b162761eb3929f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.172410:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013483af5/0x4b162761eb3929f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.172435:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013483af5/0x4b162761eb3929f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.172443:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013483af5/0x4b162761eb3929f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.172470:0:12018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788744695.173786:0:12018:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3310:x1875634475311744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1498us (2321us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788744695.173798:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1788744695.173910:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744695.173919:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013483af5/0x4b162761eb3929f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744695.173930:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81400 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744695.173935:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013483af5/0x4b162761eb3929f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744695.173946:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013483af5/0x4b162761eb3929f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744695.173965:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013483af5/0x4b162761eb3929f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744695.173972:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013483af5/0x4b162761eb3929f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744695.173994:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744695.173996:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744695.173997:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788744695.174537:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93a23c079c00/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788744695.174545:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c079c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475311744:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788744695.179840:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1788744695.180021:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:0.0:1788744695.193927:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744695.194298:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451191168 00000100:00100000:1.0:1788744695.194308:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451191168 00000100:00100000:1.0:1788744695.194387:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 155 00000100:00100000:1.0:1788744695.194398:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+16:11419:x1875634451191168:12345-192.168.201.6@tcp:101:stat.0 00010000:00010000:1.0:1788744695.194422:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744695.194444:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb3929f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d550b7 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.194522:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb3929ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.194560:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb3929ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.194573:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb3929ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.194592:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.194600:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.194606:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788744695.194769:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788744695.195057:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392a0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.195070:0:11306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3929dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550b0 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.195079:0:11306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392a0d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.195113:0:11306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3929dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550b0 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.195606:0:11306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3929dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550b0 expref: 17 pid: 5842 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744695.195638:0:11306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475311872:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744695.195870:0:11306:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744695.201401:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744695.201982:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451191424 00000100:00100000:0.0:1788744695.201993:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451191424 00000100:00100000:0.0:1788744695.202057:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:0.0:1788744695.202067:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+18:5599:x1875634451191424:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788744695.202618:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+19:5599:x1875634451191424:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 551us (1225us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788744695.202627:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:2.0:1788744695.203464:0:11306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475311872:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744695.203506:0:11306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392a0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744695.205246:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744695.205397:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451191552 00000100:00100000:2.0:1788744695.205405:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451191552 00010000:00010000:2.0:1788744695.205451:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3929dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550b0 expref: 19 pid: 5842 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744695.205517:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:2.0:1788744695.205527:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+19:2360:x1875634451191552:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744695.205543:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744695.205552:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3929dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550b0 expref: 19 pid: 5842 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.205564:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3929dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550b0 expref: 19 pid: 5842 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.205585:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb3929dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550b0 expref: 19 pid: 5842 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.205602:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:2.0:1788744695.205609:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392a0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.205617:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.205625:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392a0d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.205909:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744695.205958:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+18:2360:x1875634451191552:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 433us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744695.205965:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 66 00010000:00010000:1.0:1788744695.206038:0:11306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206047:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744695.206092:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788744695.206097:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744695.206117:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206168:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206179:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb3929ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206185:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb3929ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206192:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb3929ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206197:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744695.206202:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb3929ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206209:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb3929ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206238:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:1.0:1788744695.206241:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744695.206246:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb3929ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206252:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb3929ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206264:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206270:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206275:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206280:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744695.206283:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206288:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206295:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a203446900) 00010000:00010000:1.0:1788744695.206297:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744695.206300:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206305:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206359:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb3929f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550b7 expref: 18 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206373:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392a0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550b7 expref: 17 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.206380:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:1.0:1788744695.206383:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744695.206385:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051bc00, rc 0) 00000100:00100000:1.0:1788744695.206436:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+17:11419:x1875634451191168:12345-192.168.201.6@tcp:101:stat.0 Request processed in 12040us (12521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744695.206444:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 155 00000100:00100000:3.0:1788744695.297304:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744695.298905:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451191808 00000100:00100000:2.0:1788744695.298934:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451191808 00000100:00100000:2.0:1788744695.299007:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 156 00000100:00100000:2.0:1788744695.299018:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+17:11425:x1875634451191808:12345-192.168.201.6@tcp:36:truncate.0 00010000:00010000:2.0:1788744695.299080:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744695.299109:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392a0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550b7 expref: 17 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.299888:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:2.0:1788744695.299898:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744695.300286:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392a14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.300316:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392a14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.300328:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392a14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744695.300387:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788744695.300423:0:5841:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000929662bb reply state 00000000dd09b462 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392a14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744695.300434:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744695.300586:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+19:11425:x1875634451191808:12345-192.168.201.6@tcp:36:truncate.0 Request processed in 1566us (3297us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788744695.300594:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 156 00000020:00080000:3.0:1788744695.300599:0:5841:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788744695.304006:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392a14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.304024:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392a14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.304031:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392a14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.304038:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744695.304042:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392a14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.304050:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392a14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.304068:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744695.304070:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744695.304075:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392a14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.305074:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392a14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744695.460820:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744695.460899:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451191936 00000100:00100000:3.0:1788744695.460910:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451191936 00000100:00100000:3.0:1788744695.460989:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 157 00000100:00100000:3.0:1788744695.461011:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+18:11439:x1875634451191936:12345-192.168.201.6@tcp:101:stat.0 00010000:00010000:3.0:1788744695.461059:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744695.461085:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392a1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d550be expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461265:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392a22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461281:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392a22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461294:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392a22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461310:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392a29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461318:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392a29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461326:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392a29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461693:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392a30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461703:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461711:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744695.461756:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788744695.461766:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744695.461795:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461808:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461818:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392a22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461826:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392a22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461834:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392a22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461840:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744695.461844:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392a22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461851:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392a22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461862:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744695.461866:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744695.461870:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392a22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461877:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392a22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461890:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392a29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461906:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392a29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461912:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392a29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461917:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744695.461920:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392a29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461926:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392a29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461934:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a21a9aee00) 00010000:00010000:3.0:1788744695.461937:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744695.461940:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392a29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461946:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392a29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461983:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392a1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550be expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.461997:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392a30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550be expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.462005:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744695.462008:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744695.462016:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80c00, rc 0) 00000100:00100000:3.0:1788744695.462089:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+19:11439:x1875634451191936:12345-192.168.201.6@tcp:101:stat.0 Request processed in 1081us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744695.462098:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 157 00000100:00100000:0.0:1788744695.557256:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744695.557509:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451192192 00000100:00100000:1.0:1788744695.557520:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451192192 00000100:00100000:1.0:1788744695.557651:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 158 00000100:00100000:1.0:1788744695.557662:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+19:11449:x1875634451192192:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788744695.557684:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744695.557707:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392a37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d550c5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744695.557801:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788744695.557915:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392a37 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550c5 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.557930:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae700) 00010000:00010000:1.0:1788744695.557932:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744695.557954:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392a37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550c5 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.557970:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051a200, rc 0) 00000100:00100000:1.0:1788744695.558094:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+20:11449:x1875634451192192:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 433us (847us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788744695.558101:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 158 00000100:00100000:0.0:1788744695.562075:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744695.562178:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451192448 00000100:00100000:1.0:1788744695.562188:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451192448 00000100:00100000:1.0:1788744695.562255:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:1.0:1788744695.562268:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a210e39450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+20:11449:x1875634451192448:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788744695.562519:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a210e39450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+21:11449:x1875634451192448:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 252us (452us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788744695.562527:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:1.0:1788744695.604763:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a2064b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475312128:0@lo:400:kworker.0 00000100:00100000:1.0:1788744695.604837:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744695.604929:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744695.604945:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475312000:0@lo:400:kworker.0 00000100:00100000:0.0:1788744695.604989:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744695.605234:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475312128 00000100:00100000:3.0:1788744695.605243:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475312128 00000100:00100000:3.0:1788744695.605312:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788744695.605322:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475312128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744695.605424:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475312000 00000100:00100000:0.0:1788744695.605428:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475312000 00000100:00100000:0.0:1788744695.605460:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788744695.605468:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3309:x1875634475312000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744695.605506:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3309:x1875634475312000:12345-0@lo:400:kworker.0 Request processed in 38us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744695.605513:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788744695.605559:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475312000:0@lo:400:kworker.0 00000100:00100000:0.0:1788744695.606418:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875634475312256:0@lo:400:kworker.0 00000100:00100000:0.0:1788744695.606461:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744695.606516:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475312256 00000100:00100000:0.0:1788744695.606522:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475312256 00000100:00100000:0.0:1788744695.606563:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788744695.606572:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875634475312256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744695.606614:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875634475312256:12345-0@lo:400:kworker.0 Request processed in 43us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744695.606651:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788744695.606686:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875634475312256:0@lo:400:kworker.0 00000100:00080000:0.0:1788744695.606723:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744695.612337:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475312128:12345-0@lo:400:kworker.0 Request processed in 7005us (7488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744695.612354:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788744695.612877:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744695.612892:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a204ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475312640:0@lo:400:kworker.0 00000100:00100000:2.0:1788744695.612953:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744695.612995:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475312640 00000100:00100000:2.0:1788744695.613015:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475312640 00000100:00100000:2.0:1788744695.613073:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788744695.613082:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475312640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744695.613152:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475312640:12345-0@lo:400:kworker.0 Request processed in 71us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744695.613159:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788744695.613184:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744695.613234:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a204ff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475312640:0@lo:400:kworker.0 00000100:00100000:2.0:1788744695.613263:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634475312512:0@lo:400:kworker.0 00000100:00100000:2.0:1788744695.613304:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744695.613328:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744695.613334:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a241d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475312384:0@lo:400:kworker.0 00000100:00100000:2.0:1788744695.613356:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744695.613400:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475312384 00000100:00100000:2.0:1788744695.613404:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475312384 00000100:00100000:2.0:1788744695.613431:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788744695.613438:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634475312384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744695.613489:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634475312384:12345-0@lo:400:kworker.0 Request processed in 52us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744695.613496:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788744695.613521:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1788744695.613527:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1788744695.613547:0:3310:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93a23c079c00 x1875634475311744/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788744711 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744695.613558:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a241d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475312384:0@lo:400:kworker.0 00000100:00100000:2.0:1788744695.613579:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475312512 00000100:00100000:2.0:1788744695.613583:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475312512 00000100:00100000:2.0:1788744695.613620:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788744695.613628:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a204ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634475312512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744695.613919:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a204ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634475312512:12345-0@lo:400:kworker.0 Request processed in 292us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744695.613927:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1788744695.613945:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744695.613961:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a106fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634475312512:0@lo:400:kworker.0 00000100:00100000:1.0:1788744695.615186:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a2064b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475312128:0@lo:400:kworker.0 00000100:00100000:0.0:1788744695.627080:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744695.627607:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451192704 00000100:00100000:1.0:1788744695.627619:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451192704 00000100:00100000:1.0:1788744695.627694:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 159 00000100:00100000:1.0:1788744695.627705:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+21:11455:x1875634451192704:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1788744695.627730:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744695.627753:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392a45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d550cc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.627857:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.627885:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392a30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550be expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.627893:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a4c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.627927:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392a30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550be expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.627941:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392a30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550be expref: 22 pid: 5842 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744695.627954:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd83480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875634475312768:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744695.628043:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744695.634956:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744695.635054:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451192832 00000100:00100000:3.0:1788744695.635066:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451192832 00010000:00010000:3.0:1788744695.635192:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392a30 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550be expref: 23 pid: 5842 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744695.635246:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 67 00000100:00100000:3.0:1788744695.635262:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d117800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+23:2359:x1875634451192832:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744695.635281:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744695.635298:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392a30 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550be expref: 23 pid: 5842 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.635318:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392a30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550be expref: 23 pid: 5842 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.635343:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744695.635349:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.635375:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.635381:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392a30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550be expref: 23 pid: 5842 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.635384:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a4c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744695.635399:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd83480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875634475312768:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744695.635403:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744695.635425:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.635434:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.635440:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744695.635460:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000100:00100000:3.0:1788744695.635467:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d117800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+22:2359:x1875634451192832:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 211us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744695.635475:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 67 00010000:00010000:1.0:1788744695.636270:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392a45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550cc expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.636291:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550cc expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.636299:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:1.0:1788744695.636302:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788744695.636305:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051a600, rc 0) 00000100:00100000:1.0:1788744695.636354:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+22:11455:x1875634451192704:12345-192.168.201.6@tcp:101:bash.0 Request processed in 8652us (9293us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788744695.636361:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 159 00000100:00100000:0.0:1788744695.639565:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744695.639673:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451193088 00000100:00100000:2.0:1788744695.639684:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451193088 00000100:00100000:2.0:1788744695.639746:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 160 00000100:00100000:2.0:1788744695.639755:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+22:11455:x1875634451193088:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:2.0:1788744695.640047:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392a5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.640080:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392a5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.640095:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392a5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744695.640187:0:11306:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788744695.640214:0:11306:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000bf3c3c0a reply state 000000003e5bc8b7 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392a5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744695.640239:0:11306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744695.640344:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+25:11455:x1875634451193088:12345-192.168.201.6@tcp:36:bash.0 Request processed in 589us (788us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788744695.640352:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 160 00000020:00080000:2.0:1788744695.640358:0:11306:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788744695.648227:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744695.648311:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451193216 00000100:00100000:1.0:1788744695.648324:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451193216 00000100:00100000:1.0:1788744695.648394:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 161 00000100:00100000:1.0:1788744695.648404:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+25:11455:x1875634451193216:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1788744695.648431:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744695.648457:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392a61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d550d3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.648597:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392a68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.648613:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a4c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550cc expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.648621:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392a5a lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.648642:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392a68 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.648698:0:5842:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392a5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.648724:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550cc expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.648739:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550cc expref: 26 pid: 5840 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744695.648754:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd83480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475312896:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744695.648917:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9fa80 going to sleep for 11 seconds 00010000:00010000:3.0:1788744695.652659:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392a5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.652677:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392a5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.652685:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392a5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.652691:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2a00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744695.652696:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392a5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.652703:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392a5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.652720:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744695.652724:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744695.652728:0:3294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392a68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.652750:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392a5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.652757:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392a5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744695.652980:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd83480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475312896:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744695.653011:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392a68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744695.656587:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744695.656798:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451193344 00000100:00100000:3.0:1788744695.656811:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451193344 00010000:00010000:3.0:1788744695.656857:0:7626:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550cc expref: 26 pid: 5840 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744695.656901:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:3.0:1788744695.656912:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d117b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+26:2360:x1875634451193344:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744695.656927:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744695.656935:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550cc expref: 26 pid: 5840 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.656949:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550cc expref: 26 pid: 5840 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.656971:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392a4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550cc expref: 26 pid: 5840 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.656987:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744695.656992:0:7626:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392a68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.657001:0:7626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.657024:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392a68 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.657058:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744695.657120:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d117b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+25:2360:x1875634451193344:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 209us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744695.657162:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 68 00010000:00010000:1.0:1788744695.657317:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.657327:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744695.657377:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788744695.657382:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744695.657403:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.657450:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392a61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550d3 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.657468:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392a68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550d3 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.657487:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:1.0:1788744695.657490:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744695.657493:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051ae00, rc 0) 00000100:00100000:1.0:1788744695.657523:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+24:11455:x1875634451193216:12345-192.168.201.6@tcp:101:bash.0 Request processed in 9120us (9313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744695.657530:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 161 00000100:00100000:0.0:1788744695.660024:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744695.660171:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451193600 00000100:00100000:1.0:1788744695.660186:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451193600 00000100:00100000:1.0:1788744695.660263:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:1.0:1788744695.660277:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+24:11455:x1875634451193600:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:1.0:1788744695.660895:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+25:11455:x1875634451193600:12345-192.168.201.6@tcp:35:bash.0 Request processed in 619us (881us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788744695.660903:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:0.0:1788744695.735665:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744695.735769:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451193856 00000100:00100000:2.0:1788744695.735781:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451193856 00000100:00100000:2.0:1788744695.735907:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 162 00000100:00100000:2.0:1788744695.735919:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+25:11465:x1875634451193856:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744695.735944:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744695.735965:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb392a6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d550da expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744695.736060:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788744695.736233:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb392a6f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550da expref: 27 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.736247:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae700) 00010000:00010000:2.0:1788744695.736259:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744695.736266:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb392a6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550da expref: 27 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.736283:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3800, rc 0) 00000100:00100000:2.0:1788744695.736345:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+26:11465:x1875634451193856:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 428us (689us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788744695.736352:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 162 00000100:00100000:3.0:1788744695.739342:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744695.739440:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451193984 00000100:00100000:1.0:1788744695.739451:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451193984 00000100:00100000:1.0:1788744695.739545:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 163 00000100:00100000:1.0:1788744695.739557:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+26:11465:x1875634451193984:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:1.0:1788744695.739636:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392a7d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.739667:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392a7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.739677:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392a7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.739688:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392a84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.739693:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.739697:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740215:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392a8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740236:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740244:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744695.740297:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740313:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392a7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740319:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392a7d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740337:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392a7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740344:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744695.740347:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392a7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740355:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392a7d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740370:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:1.0:1788744695.740373:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744695.740379:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392a7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740385:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392a7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740399:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740404:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392a84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740410:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740415:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744695.740419:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740435:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392a84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740442:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a203446900) 00010000:00010000:1.0:1788744695.740444:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744695.740448:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392a84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740453:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392a84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740469:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740476:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392a8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740482:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740487:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051aa00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744695.740490:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740495:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392a8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740502:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:1.0:1788744695.740505:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744695.740508:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392a8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.740523:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392a8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744695.740607:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+26:11465:x1875634451193984:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 1050us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744695.740615:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 163 00000100:00100000:0.0:1788744695.743100:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744695.743290:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451194240 00000100:00100000:3.0:1788744695.743302:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451194240 00000100:00100000:3.0:1788744695.743355:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:3.0:1788744695.743365:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+26:11465:x1875634451194240:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1788744695.744008:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+27:11465:x1875634451194240:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 641us (912us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788744695.744017:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:0.0:1788744695.789076:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744695.789197:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451194496 00000100:00100000:2.0:1788744695.789207:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451194496 00000100:00100000:2.0:1788744695.789276:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 164 00000100:00100000:2.0:1788744695.789287:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+27:11468:x1875634451194496:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744695.789313:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744695.789335:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb392a92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d550e1 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.789452:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392a99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.789476:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.789489:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.789505:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb392aa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.789512:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb392aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.789531:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb392aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.789851:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392aa7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.789861:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.789869:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744695.789880:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788744695.789973:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.789981:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392a99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.789988:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392a99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.789994:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744695.789999:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392a99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.790006:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392a99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.790018:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:2.0:1788744695.790021:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744695.790033:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392a99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.790039:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392a99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.790052:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb392aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.790059:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb392aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.790065:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb392aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.790070:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744695.790073:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb392aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.790079:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb392aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.790087:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a209e2e300) 00010000:00010000:2.0:1788744695.790090:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744695.790092:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb392aa0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.790097:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb392aa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.790195:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3800/0x4b162761eb392a92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550e1 expref: 30 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.790232:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550e1 expref: 29 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.790239:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:2.0:1788744695.790241:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744695.790244:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2c00, rc 0) 00000100:00100000:2.0:1788744695.790315:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+29:11468:x1875634451194496:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1028us (1248us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788744695.790323:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 164 00000100:00100000:0.0:1788744695.793652:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744695.793771:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451194624 00000100:00100000:2.0:1788744695.793782:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451194624 00000100:00100000:2.0:1788744695.793845:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 165 00000100:00100000:2.0:1788744695.793854:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+29:11468:x1875634451194624:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:2.0:1788744695.793921:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392ab5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.793938:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.793950:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.793975:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.793982:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392ab5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.794192:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.794198:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744695.794202:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.794210:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392ab5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.794229:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:2.0:1788744695.794232:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744695.794238:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392ab5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.794243:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392ab5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744695.794324:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+29:11468:x1875634451194624:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 470us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744695.794331:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 165 00000100:00100000:3.0:1788744695.795720:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744695.795789:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451194752 00000100:00100000:2.0:1788744695.795798:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451194752 00000100:00100000:2.0:1788744695.795856:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:2.0:1788744695.795865:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c078000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+29:2360:x1875634451194752:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744695.795882:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744695.795903:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392aa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550e1 expref: 29 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.795934:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:2.0:1788744695.795939:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744695.796100:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c078000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+28:2360:x1875634451194752:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 236us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744695.796108:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1788744695.797897:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744695.802126:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451195008 00000100:00100000:1.0:1788744695.802163:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451195008 00000100:00100000:1.0:1788744695.802352:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:1.0:1788744695.802365:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+28:11468:x1875634451195008:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788744695.802670:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+29:11468:x1875634451195008:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 307us (4780us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788744695.802679:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00010000:00010000:2.0:1788744695.924413:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744695.932676:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744695.932738:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451195264 00000100:00100000:2.0:1788744695.932749:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451195264 00000100:00100000:2.0:1788744695.932810:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 166 00000100:00100000:2.0:1788744695.932821:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+29:11486:x1875634451195264:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:2.0:1788744695.932847:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744695.932870:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392abc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d550e8 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.932978:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392ac3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.932994:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392ac3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.933013:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392ac3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744695.933029:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788744695.933887:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392abc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550e8 expref: 32 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.933915:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392ac3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550e8 expref: 31 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.933941:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:2.0:1788744695.933945:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788744695.933948:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2400, rc 0) 00000100:00100000:2.0:1788744695.934087:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+31:11486:x1875634451195264:12345-192.168.201.6@tcp:101:cat.0 Request processed in 1266us (1418us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788744695.934095:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 166 00000100:00100000:0.0:1788744695.962343:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744695.962439:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451195392 00000100:00100000:1.0:1788744695.962449:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451195392 00000100:00100000:1.0:1788744695.962510:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 167 00000100:00100000:1.0:1788744695.962521:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+31:11487:x1875634451195392:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788744695.962545:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744695.962567:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392ad1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d550ef expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.962644:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392ad8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.962659:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.962691:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744695.962723:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788744695.962725:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744695.962738:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.962758:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392ad1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550ef expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.962772:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550ef expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744695.962778:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:1.0:1788744695.962780:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744695.962783:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051a200, rc 0) 00000100:00100000:1.0:1788744695.962843:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11487:x1875634451195392:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 323us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744695.962850:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 167 00000100:00100000:0.0:1788744695.967257:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744695.967385:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451195776 00000100:00100000:3.0:1788744695.967394:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451195776 00000100:00100000:3.0:1788744695.967449:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:3.0:1788744695.967460:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11487:x1875634451195776:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1788744695.967796:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+33:11487:x1875634451195776:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 337us (547us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788744695.967804:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:0.0:1788744695.971078:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744695.971575:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451195904 00000100:00100000:3.0:1788744695.971587:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451195904 00000100:00100000:3.0:1788744695.971706:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:3.0:1788744695.971732:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d568380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+33:11487:x1875634451195904:12345-192.168.201.6@tcp:103:lfs.0 00010000:00010000:3.0:1788744695.971750:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788744695.971773:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392a68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550d3 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.971797:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392ac3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550e8 expref: 32 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.971809:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb39296c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55094 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744695.973330:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744695.973342:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744695.973425:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d568380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+30:11487:x1875634451195904:12345-192.168.201.6@tcp:103:lfs.0 Request processed in 1692us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744695.973434:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1788744695.976578:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744695.976714:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451196032 00000100:00100000:2.0:1788744695.976727:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451196032 00000100:00100000:2.0:1788744695.976883:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 168 00000100:00100000:2.0:1788744695.976894:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+30:11487:x1875634451196032:12345-192.168.201.6@tcp:58:lfs.0 00010000:00010000:2.0:1788744695.977026:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392adf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.977043:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392adf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744695.977056:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392adf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744695.977455:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788744695.977573:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+30:11487:x1875634451196032:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 680us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744695.977582:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 168 00000100:00100000:0.0:1788744696.003621:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744696.003766:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451196160 00000100:00100000:1.0:1788744696.003776:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451196160 00000100:00100000:1.0:1788744696.003842:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 169 00000100:00100000:1.0:1788744696.003853:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+30:11489:x1875634451196160:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788744696.003876:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744696.003898:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392ae6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d550f6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.004056:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392aed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.004069:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392aed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.004080:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392aed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.004093:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392af4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.004100:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.004106:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.007770:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392afb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.007796:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.007809:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744696.007868:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788744696.007873:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744696.007894:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.007920:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.007928:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392aed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.007934:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392aed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.007941:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392aed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.007946:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744696.007950:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392aed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.007956:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392aed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.007966:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:1.0:1788744696.007968:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744696.007973:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392aed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.007978:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392aed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.007991:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.007997:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392af4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.008009:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392af4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.008014:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744696.008018:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392af4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.008024:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392af4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.008033:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a203446900) 00010000:00010000:1.0:1788744696.008039:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744696.008043:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392af4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.008048:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392af4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.008089:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392ae6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550f6 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.008102:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392afb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550f6 expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.008109:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:1.0:1788744696.008110:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744696.008113:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051ac00, rc 0) 00000100:00100000:1.0:1788744696.008247:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+31:11489:x1875634451196160:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 4394us (4636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744696.008265:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 169 00000100:00100000:1.0:1788744696.117000:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744696.117031:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475313024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744696.117117:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744696.117229:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475313024 00000100:00100000:1.0:1788744696.117239:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475313024 00000100:00100000:1.0:1788744696.117297:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788744696.117307:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475313024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744696.117348:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744696.117395:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475313024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744696.117415:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788744696.117486:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475313024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744696.232838:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744696.232875:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744696.232913:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744696.232944:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744696.232985:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451196288 00000100:00100000:0.0:1788744696.232997:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451196288 00000100:00100000:0.0:1788744696.233064:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 294 00000100:00100000:0.0:1788744696.233092:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2360:x1875634451196288:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744696.233199:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2360:x1875634451196288:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 108us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744696.233207:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 294 00000100:00100000:0.0:1788744696.233251:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451196416 00000100:00100000:0.0:1788744696.233255:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451196416 00000100:00100000:0.0:1788744696.233300:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451196544 00000100:00100000:0.0:1788744696.233303:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451196544 00000100:00100000:0.0:1788744696.233329:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:0.0:1788744696.233336:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2360:x1875634451196416:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744696.233369:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2360:x1875634451196416:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 33us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744696.233375:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:0.0:1788744696.233387:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 87 00000100:00100000:0.0:1788744696.233393:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2360:x1875634451196544:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744696.233416:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2360:x1875634451196544:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 23us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744696.233422:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 87 00000100:00080000:0.0:1788744696.233559:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744696.233563:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744696.235745:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451196672 00000100:00100000:2.0:1788744696.235767:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451196672 00000100:00100000:2.0:1788744696.235897:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 152 00000100:00100000:2.0:1788744696.235910:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2360:x1875634451196672:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744696.236187:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2360:x1875634451196672:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 280us (3308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744696.236195:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 152 00000100:00080000:0.0:1788744696.236524:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788744696.245102:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744696.245112:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744696.245192:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788744696.245200:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744696.245348:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c079f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875634475313152:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744696.245545:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c40b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744696.260895:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744696.262103:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451196800 00000100:00100000:2.0:1788744696.262117:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451196800 00000100:00100000:2.0:1788744696.262376:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 170 00000100:00100000:2.0:1788744696.262403:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11501:x1875634451196800:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788744696.262446:0:5842:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788744696.262726:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11501:x1875634451196800:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 339us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744696.262733:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 170 00000100:00100000:3.0:1788744696.264163:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c079f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875634475313152:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788744696.266923:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744696.267057:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451196928 00000100:00100000:2.0:1788744696.267066:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451196928 00000100:00100000:2.0:1788744696.267125:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 171 00000100:00100000:2.0:1788744696.267169:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+31:11501:x1875634451196928:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788744696.267250:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392b02 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267268:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392b02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267281:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392b02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267296:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b09 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267304:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267327:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267357:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392b10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267366:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267373:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744696.267412:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788744696.267418:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744696.267434:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267445:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392b02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267450:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392b02 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267456:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392b02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267598:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744696.267604:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392b02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267612:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392b02 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267631:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93a203446f00) 00010000:00010000:2.0:1788744696.267634:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744696.267640:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392b02 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267648:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392b02 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267661:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267668:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b09 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267674:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267680:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2e00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744696.267683:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267689:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b09 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267697:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff93a209e2e900) 00010000:00010000:2.0:1788744696.267700:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744696.267702:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b09 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267708:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b09 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267734:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267741:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392b10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267747:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392b10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267752:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744696.267754:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392b10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267760:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392b10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267767:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:2.0:1788744696.267770:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744696.267773:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392b10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.267778:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392b10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744696.268217:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+31:11501:x1875634451196928:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 Request processed in 1039us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744696.268226:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 171 00000100:00100000:2.0:1788744696.282609:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744696.282738:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451197184 00000100:00100000:1.0:1788744696.282749:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451197184 00000100:00100000:1.0:1788744696.282826:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 172 00000100:00100000:1.0:1788744696.282837:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a106fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+31:11501:x1875634451197184:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744696.282862:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744696.282889:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392b17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d550fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.283490:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.283511:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.283545:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744696.283559:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788744696.283663:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.283672:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.283679:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.283685:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744696.283690:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.283698:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.283710:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:1.0:1788744696.283713:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744696.283719:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.283725:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.283766:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392b17 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550fd expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.283788:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93a203446f00) 00010000:00010000:1.0:1788744696.283790:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744696.283795:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392b17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550fd expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.283816:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051b000, rc 0) 00000100:00100000:1.0:1788744696.283872:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a106fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11501:x1875634451197184:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1037us (1277us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1788744696.283880:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 172 00000100:00100000:0.0:1788744696.301929:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744696.302091:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451197312 00000100:00100000:2.0:1788744696.302102:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451197312 00000100:00100000:2.0:1788744696.302221:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 173 00000100:00100000:2.0:1788744696.302234:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11501:x1875634451197312:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788744696.302278:0:5841:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788744696.302410:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11501:x1875634451197312:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 178us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744696.302417:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 173 00000100:00100000:0.0:1788744696.306874:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744696.306996:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451197568 00000100:00100000:3.0:1788744696.307005:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451197568 00000100:00100000:3.0:1788744696.307055:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 174 00000100:00100000:3.0:1788744696.307064:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11501:x1875634451197568:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744696.307164:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744696.307168:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788744696.307196:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392ad8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550ef expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.307225:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744696.307230:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744696.307244:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392b2c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55104 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788744696.308369:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788744696.308633:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392b33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.308648:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.308661:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.308722:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392b2c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55104 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.308740:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392b33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55104 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.308748:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744696.308751:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744696.308761:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81400, rc 0) 00000100:00100000:3.0:1788744696.312537:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+33:11501:x1875634451197568:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 5459us (5654us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788744696.312548:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 174 00000100:00100000:2.0:1788744696.316822:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744696.316911:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451197824 00000100:00100000:3.0:1788744696.316923:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451197824 00000100:00100000:3.0:1788744696.316987:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 175 00000100:00100000:3.0:1788744696.316998:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+33:11501:x1875634451197824:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788744696.317058:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744696.317085:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392b33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55104 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317101:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744696.317112:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744696.317185:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392b41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317201:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392b41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317224:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392b41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317278:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x9c3cbdb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317285:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9c3cbdb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317292:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9c3cbdb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317523:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392b41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317531:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392b41 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317538:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392b41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317545:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744696.317549:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392b41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317556:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392b41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317566:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744696.317569:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744696.317573:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392b41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317579:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392b41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317589:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9c3cbdb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317595:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9c3cbdb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317600:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9c3cbdb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317611:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744696.317614:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9c3cbdb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317621:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9c3cbdb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317628:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x9c3cbdb2 (ffff93a21a9aee00) 00010000:00010000:3.0:1788744696.317631:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744696.317634:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9c3cbdb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.317641:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9c3cbdb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744696.317738:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11501:x1875634451197824:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 741us (925us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744696.317746:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 175 00000100:00100000:0.0:1788744696.324625:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744696.325571:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451197952 00000100:00100000:2.0:1788744696.325583:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451197952 00000100:00100000:2.0:1788744696.325642:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 176 00000100:00100000:2.0:1788744696.325654:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11501:x1875634451197952:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744696.325678:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744696.325704:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392b4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5510b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.325743:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.325756:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.325768:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.325859:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392b4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5510b expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.325876:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5510b expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.325891:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93a209e2e900) 00010000:00010000:2.0:1788744696.325893:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788744696.325897:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2e00, rc 0) 00000100:00100000:2.0:1788744696.325960:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+33:11501:x1875634451197952:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 308us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744696.325968:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 176 00000100:00100000:0.0:1788744696.339943:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744696.340088:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451198208 00000100:00100000:1.0:1788744696.340098:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451198208 00000100:00100000:1.0:1788744696.340195:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 177 00000100:00100000:1.0:1788744696.340217:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+33:11501:x1875634451198208:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788744696.340313:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.340333:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.340345:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744696.340659:0:11306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1788744696.340670:0:11306:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 399039538907ns, next at 400039536379ns, rc = 0 00000004:00010000:1.0:1788744696.340751:0:11306:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000068a7c5db reply state 0000000036305362 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744696.340778:0:11306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788744696.340873:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+35:11501:x1875634451198208:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 667us (941us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788744696.340880:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 177 00010000:00010000:3.0:1788744696.342765:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.342781:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.342790:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.342796:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744696.342802:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.342829:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.342846:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93a209e2e900) 00010000:00010000:3.0:1788744696.342849:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788744696.342855:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.342861:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392b5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744696.344478:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744696.344592:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451198336 00000100:00100000:3.0:1788744696.344602:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451198336 00000100:00100000:3.0:1788744696.344662:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 178 00000100:00100000:3.0:1788744696.344673:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+34:11501:x1875634451198336:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744696.344697:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744696.344718:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55112 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.344777:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55112 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.344793:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55112 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.344823:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93a209e2e900) 00010000:00010000:3.0:1788744696.344827:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744696.344831:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80c00, rc 0) 00000100:00100000:3.0:1788744696.344892:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+35:11501:x1875634451198336:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 221us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744696.344899:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 178 00000100:00100000:0.0:1788744696.348013:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744696.348092:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451198464 00000100:00100000:3.0:1788744696.348112:0:12018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451198464 00000100:00100000:3.0:1788744696.348190:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:3.0:1788744696.348201:0:12018:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2360:x1875634451198464:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788744696.348856:0:12018:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2360:x1875634451198464:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 654us (848us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788744696.348865:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:0.0:1788744696.351965:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744696.352117:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451198720 00000100:00100000:3.0:1788744696.352127:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451198720 00000100:00100000:3.0:1788744696.352204:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:3.0:1788744696.352223:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+35:11501:x1875634451198720:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788744696.352457:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+36:11501:x1875634451198720:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 235us (500us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788744696.352466:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:0.0:1788744696.363517:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744696.363595:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451198976 00000100:00100000:1.0:1788744696.363605:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451198976 00000100:00100000:1.0:1788744696.363704:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 179 00000100:00100000:1.0:1788744696.363715:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+36:11501:x1875634451198976:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788744696.363860:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+36:11501:x1875634451198976:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 146us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744696.363867:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 179 00000100:00100000:0.0:1788744696.367165:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744696.367299:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451199104 00000100:00100000:3.0:1788744696.367309:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451199104 00000100:00100000:3.0:1788744696.367366:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 180 00000100:00100000:3.0:1788744696.367378:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+36:11501:x1875634451199104:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744696.367403:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744696.367426:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392b6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55119 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.367529:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392b72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.367550:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.367562:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744696.367601:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744696.367620:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.367647:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392b6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55119 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.367663:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392b72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55119 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.367672:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93a209e2e900) 00010000:00010000:3.0:1788744696.367676:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788744696.367679:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81400, rc 0) 00000100:00100000:3.0:1788744696.367729:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+37:11501:x1875634451199104:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 353us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744696.367736:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 180 00000100:00100000:0.0:1788744696.372691:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744696.372727:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451199232 00000100:00100000:0.0:1788744696.372737:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451199232 00000100:00100000:0.0:1788744696.372787:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:0.0:1788744696.372797:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2361:x1875634451199232:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744696.372825:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744696.372846:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3be5eb2/0x4b162761eb392b79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55120 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744696.372874:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e13f7, blocks: 0x1 00010000:00010000:0.0:1788744696.372893:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1788744696.372898:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744696.372908:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3be5eb2/0x4b162761eb392b79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55120 expref: 8 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.372926:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3be5eb2/0x4b162761eb392b79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55120 expref: 8 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.372940:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17ea00, rc 0) 00000100:00100000:0.0:1788744696.372994:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2361:x1875634451199232:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 197us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744696.373018:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:0.0:1788744696.376760:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744696.378111:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451199488 00000100:00100000:3.0:1788744696.378246:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451199488 00000100:00100000:3.0:1788744696.378307:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 181 00000100:00100000:3.0:1788744696.378317:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+37:11501:x1875634451199488:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788744696.378469:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+37:11501:x1875634451199488:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 142us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744696.378491:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 181 00000100:00100000:0.0:1788744696.391523:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744696.391684:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451199616 00000100:00100000:3.0:1788744696.391696:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451199616 00000100:00100000:3.0:1788744696.391752:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:3.0:1788744696.391763:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+8:11501:x1875634451199616:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744696.391783:0:9032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744696.391813:0:9032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392b80 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55127 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.391847:0:9032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3be5eb2/0x4b162761eb392b79 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55120 expref: 9 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.391857:0:9032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744696.391862:0:9032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744696.391867:0:9032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392b80 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55127 expref: 9 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.391905:0:9032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3be5eb2/0x4b162761eb392b79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55120 expref: 9 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.391921:0:9032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3be5eb2/0x4b162761eb392b79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55120 expref: 9 pid: 6685 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744696.391935:0:9032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c079f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9032:1875634475313280:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788744696.392028:0:9032:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c40b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788744696.398484:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744696.402525:0:9032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c079f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9032:1875634475313280:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744696.402559:0:9032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392b80 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55127 expref: 9 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.402583:0:9032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80800, rc 0) 00000100:00100000:3.0:1788744696.402654:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+9:11501:x1875634451199616:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 10892us (11137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744696.402664:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:2.0:1788744696.402930:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451199744 00000100:00100000:2.0:1788744696.402939:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451199744 00010000:00010000:2.0:1788744696.402979:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3be5eb2/0x4b162761eb392b79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55120 expref: 9 pid: 6685 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744696.403012:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:2.0:1788744696.403022:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20d761050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2359:x1875634451199744:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744696.403039:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744696.403064:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3be5eb2/0x4b162761eb392b79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55120 expref: 9 pid: 6685 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.403077:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3be5eb2/0x4b162761eb392b79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55120 expref: 9 pid: 6685 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.403103:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3be5eb2/0x4b162761eb392b79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55120 expref: 9 pid: 6685 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.403116:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744696.403160:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744696.403170:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392b80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55127 expref: 8 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.403180:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392b80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55127 expref: 8 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.403225:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392b80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55127 expref: 8 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744696.403240:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875634475313408:192.168.201.6@tcp:105: 00000100:00100000:2.0:1788744696.403304:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204849480 going to sleep for 11 seconds 00000100:00100000:3.0:1788744696.410688:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875634475313408:192.168.201.6@tcp:105: 00010000:00010000:3.0:1788744696.410715:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744696.410767:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20d761050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2359:x1875634451199744:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 7746us (12290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744696.410778:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:1.0:1788744696.413649:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744696.413719:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451199872 00000100:00100000:3.0:1788744696.413729:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451199872 00002000:00100000:3.0:1788744696.413778:0:6690:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93a23cd81c00 x1875634451199872/t0(0) o4->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:217/0 lens 504/0 e 0 to 0 dl 1788744707 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788744696.413789:0:6690:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a23cd81c00 with x1875634451199872 ext(0->8) 00002000:00010000:3.0:1788744696.413795:0:6690:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93a23cd81c00 00000100:00100000:3.0:1788744696.413830:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:3.0:1788744696.413841:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2360:x1875634451199872:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788744696.414318:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+10:2360:x1875634451199872:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 Request processed in 477us (676us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788744696.414326:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00002000:00100000:3.0:1788744696.414334:0:6690:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93a23cd81c00 x1875634451199872/t4294967314(0) o4->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:217/0 lens 504/448 e 0 to 0 dl 1788744707 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788744696.414348:0:6690:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a23cd81c00 with x1875634451199872 ext(0->8) 00002000:00010000:3.0:1788744696.414352:0:6690:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93a23cd81c00 00000100:00100000:1.0:1788744696.426831:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744696.426928:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451200000 00000100:00100000:0.0:1788744696.426940:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451200000 00000100:00100000:0.0:1788744696.427006:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 182 00000100:00100000:0.0:1788744696.427016:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+37:11501:x1875634451200000:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788744696.518317:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967442 is committed 00000001:00080000:2.0:1788744696.518338:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1788744696.518343:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1788744696.518403:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1788744696.518416:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1788744696.518443:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788744696.518463:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788744696.519275:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+18:11501:x1875634451200000:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 Request processed in 92252us (92445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744696.519286:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 182 00000100:00100000:0.0:1788744696.519592:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1069b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475313536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788744696.519653:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744696.519732:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475313536 00000100:00100000:0.0:1788744696.519741:0:12018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475313536 00000100:00100000:0.0:1788744696.519780:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788744696.519789:0:12018:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475313536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788744696.521614:0:12018:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788744696.521623:0:12018:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788744695 00002000:00010000:0.0:1788744696.521625:0:12018:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788744696.521627:0:12018:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788744695 -> 1788744695 00002000:00010000:0.0:1788744696.521630:0:12018:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788744696.521719:0:12018:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3309:x1875634475313536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1928us (2063us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788744696.521730:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1788744696.522766:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93a1069b0a80/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788744696.522778:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1069b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475313536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788744696.523954:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744696.527314:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451200128 00000100:00100000:2.0:1788744696.527328:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451200128 00000100:00100000:2.0:1788744696.527388:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:2.0:1788744696.527399:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+10:2362:x1875634451200128:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788744696.563783:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1788744696.563805:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1788744696.564048:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2362:x1875634451200128:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 Request processed in 36645us (40095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744696.564060:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:1.0:1788744696.567571:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744696.567813:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451200384 00000100:00100000:3.0:1788744696.567823:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451200384 00000100:00100000:3.0:1788744696.568084:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 183 00000100:00100000:3.0:1788744696.568097:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+18:11501:x1875634451200384:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788744696.568273:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744696.568301:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392b72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55119 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.568324:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93a209e2e900) 00010000:00010000:3.0:1788744696.568329:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744696.568362:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392b87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.568376:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392b87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.568386:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392b87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744696.568780:0:5841:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000207cb997 reply state 00000000aef9e708 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392b87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744696.568810:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744696.569264:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+19:11501:x1875634451200384:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 1168us (1701us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788744696.569272:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 183 00010000:00010000:3.0:1788744696.572321:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392b87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.572341:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392b87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.572350:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392b87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.572356:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200031a00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744696.572361:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392b87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.572369:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392b87 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.572504:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93a209e2e900) 00010000:00010000:3.0:1788744696.572508:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744696.572514:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392b87 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.572521:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392b87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744696.575325:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744696.576168:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451200512 00000100:00100000:3.0:1788744696.576182:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451200512 00000100:00100000:3.0:1788744696.576289:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:3.0:1788744696.576300:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2360:x1875634451200512:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788744696.576592:0:9032:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788744696.576597:0:9032:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788744695 -> 1788744694 00002000:00010000:3.0:1788744696.576599:0:9032:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788744693 00002000:00010000:3.0:1788744696.576602:0:9032:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788744695 -> 1788744694 00002000:00010000:3.0:1788744696.576604:0:9032:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788744696.576683:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2360:x1875634451200512:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 385us (1368us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788744696.576691:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:1.0:1788744696.589402:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744696.590625:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451200768 00000100:00100000:0.0:1788744696.590636:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451200768 00000100:00100000:0.0:1788744696.590742:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 184 00000100:00100000:0.0:1788744696.590753:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+18:11501:x1875634451200768:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788744696.590825:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392b8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.590842:0:11306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5510b expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.590851:0:11306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392b8e lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.590886:0:11306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5510b expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.590911:0:11306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5510b expref: 18 pid: 5842 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744696.590926:0:11306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1069b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475313664:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788744696.591033:0:11306:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744696.598359:0:11306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1069b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475313664:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744696.598389:0:11306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392b8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744696.603775:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744696.603818:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451200896 00000100:00100000:1.0:1788744696.603827:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451200896 00010000:00010000:1.0:1788744696.603868:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5510b expref: 19 pid: 5842 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744696.603905:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:1.0:1788744696.603927:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+19:2359:x1875634451200896:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744696.603942:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744696.603950:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5510b expref: 19 pid: 5842 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.603963:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5510b expref: 19 pid: 5842 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.605157:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392b56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5510b expref: 19 pid: 5842 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.605177:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93a209e2e900) 00010000:00010000:1.0:1788744696.605182:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392b8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.605195:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.605213:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392b8e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.605245:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744696.605307:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+18:2359:x1875634451200896:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 1381us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744696.605315:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 70 00010000:00010000:3.0:1788744696.606582:0:11306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.606595:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.606626:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.606633:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392b8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.606639:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392b8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.606657:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ea00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744696.606661:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392b8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.606669:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392b8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.606682:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93a209e2e900) 00010000:00010000:3.0:1788744696.606685:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788744696.606690:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392b8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.606696:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392b8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744696.606765:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+17:11501:x1875634451200768:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 Request processed in 16011us (17370us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788744696.606774:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 184 00000100:00100000:0.0:1788744696.610884:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744696.610949:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451201024 00000100:00100000:3.0:1788744696.610961:0:12018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451201024 00000100:00100000:3.0:1788744696.611026:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:3.0:1788744696.611036:0:12018:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2360:x1875634451201024:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788744696.611082:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080c0ef29/0x4b162761eb392b95 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.611102:0:12018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392b80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55127 expref: 8 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.611123:0:12018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744696.611161:0:12018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744696.611167:0:12018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080c0ef29/0x4b162761eb392b95 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.611212:0:12018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392b80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55127 expref: 8 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.611228:0:12018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392b80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55127 expref: 8 pid: 9032 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744696.611242:0:12018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12018:1875634475313792:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788744696.611322:0:12018:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20489e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788744696.617664:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744696.617700:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451201152 00000100:00100000:1.0:1788744696.617710:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451201152 00010000:00010000:1.0:1788744696.617752:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392b80 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55127 expref: 9 pid: 9032 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744696.617797:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00100000:1.0:1788744696.617806:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a10751b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2360:x1875634451201152:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744696.617822:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744696.617844:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392b80 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55127 expref: 9 pid: 9032 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.617857:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392b80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55127 expref: 9 pid: 9032 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.617883:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744696.617887:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744696.617893:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080c0ef29/0x4b162761eb392b95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.617903:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080c0ef29/0x4b162761eb392b95 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.617926:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744696.618077:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a10751b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2360:x1875634451201152:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 270us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744696.618085:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 71 00010000:00010000:2.0:1788744696.618190:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392b80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55127 expref: 8 pid: 9032 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744696.618228:0:12018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12018:1875634475313792:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744696.618247:0:12018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080c0ef29/0x4b162761eb392b95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.618256:0:12018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080c0ef29/0x4b162761eb392b95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.618263:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080c0ef29/0x4b162761eb392b95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.618286:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080c0ef29/0x4b162761eb392b95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.618294:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080c0ef29/0x4b162761eb392b95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.618301:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080c0ef29/0x4b162761eb392b95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.618308:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200030c00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744696.618312:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080c0ef29/0x4b162761eb392b95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.618319:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080c0ef29/0x4b162761eb392b95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.618338:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080c0ef29/0x4b162761eb392b95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.618345:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080c0ef29/0x4b162761eb392b95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744696.618399:0:12018:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2360:x1875634451201024:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 Request processed in 7355us (7514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744696.618407:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:1.0:1788744696.627674:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744696.627722:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451201408 00000100:00100000:1.0:1788744696.627733:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451201408 00000100:00100000:1.0:1788744696.627791:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 185 00000100:00100000:1.0:1788744696.627810:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a10751bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+17:11501:x1875634451201408:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788744696.627889:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392b9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.627908:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392b9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.627921:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392b9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.628145:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a000/0x4b162761eb392ba3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.628158:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55112 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.628167:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a000/0x4b162761eb392ba3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.628199:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55112 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.628227:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55112 expref: 18 pid: 5842 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744696.628241:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a10751a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475313920:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744696.628321:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204c06d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744696.631792:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744696.631815:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475314048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744696.631882:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744696.631972:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475314048 00000100:00100000:1.0:1788744696.631981:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475314048 00000100:00100000:1.0:1788744696.632049:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788744696.632067:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875634475314048:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788744696.632070:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788744696.632104:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744696.632176:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875634475314048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744696.632183:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788744696.632391:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c078000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475314048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744696.632744:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744696.632773:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451201536 00000100:00100000:0.0:1788744696.632778:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451201536 00000100:00100000:1.0:1788744696.632785:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a10751a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475313920:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744696.632808:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a000/0x4b162761eb392ba3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.632808:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55112 expref: 19 pid: 5842 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744696.632870:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 72 00000100:00100000:0.0:1788744696.632879:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+19:2359:x1875634451201536:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744696.632891:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744696.632898:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55112 expref: 19 pid: 5842 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.632910:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55112 expref: 19 pid: 5842 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.632933:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392b64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55112 expref: 19 pid: 5842 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.632946:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93a209e2e900) 00010000:00010000:0.0:1788744696.632951:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a000/0x4b162761eb392ba3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.632960:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a000/0x4b162761eb392ba3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.632968:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a000/0x4b162761eb392ba3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.633144:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744696.633186:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+18:2359:x1875634451201536:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 308us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744696.633194:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 72 00010000:00010000:0.0:1788744696.633476:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a000/0x4b162761eb392ba3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.633490:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a000/0x4b162761eb392ba3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744696.633664:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788744696.633812:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788744696.633873:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788744696.633950:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1069b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1875634475314176:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788744696.633994:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744696.634028:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788744696.634198:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475314176 00000100:00100000:1.0:1788744696.634214:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475314176 00000100:00100000:1.0:1788744696.634254:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788744696.634262:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875634475314176:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788744696.634338:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875634475314176:12345-0@lo:1000:mdt00_002.0 Request processed in 77us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744696.634345:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744696.634416:0:5842:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788744696.634422:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93a1069b0a80, transno 4294967315 00000100:00100000:0.0:1788744696.634535:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1069b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1875634475314176:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788744696.634943:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788744696.635002:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1069b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1875634475314304:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788744696.635032:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744696.635052:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744696.636867:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475314304 00000100:00100000:1.0:1788744696.636879:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475314304 00000100:00100000:1.0:1788744696.636938:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744696.636948:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875634475314304:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788744696.637182:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1875634475314304:12345-0@lo:1000:mdt00_002.0 Request processed in 235us (2147us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788744696.637190:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744696.637793:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1069b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1875634475314304:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788744696.637834:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a000/0x4b162761eb392ba3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.637845:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a000/0x4b162761eb392ba3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.637854:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a000/0x4b162761eb392ba3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.637860:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744696.637864:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a000/0x4b162761eb392ba3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.637879:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a000/0x4b162761eb392ba3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.637894:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93a209e2e900) 00010000:00010000:0.0:1788744696.637897:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744696.637902:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a000/0x4b162761eb392ba3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.637908:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a000/0x4b162761eb392ba3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.637936:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392adf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.637942:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392adf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.637948:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392adf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.637953:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744696.637957:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392adf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.637963:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392adf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.637972:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:0.0:1788744696.637974:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744696.637977:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392adf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.637995:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392adf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.638019:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392baa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.638031:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392afb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d550f6 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.638038:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392baa lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.638064:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392afb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550f6 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.638077:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392afb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550f6 expref: 21 pid: 5840 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744696.638088:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1069b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475314432:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788744696.638170:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744696.641799:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744696.641921:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451201664 00000100:00100000:3.0:1788744696.641931:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451201664 00010000:00010000:3.0:1788744696.641977:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392afb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550f6 expref: 22 pid: 5840 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744696.642028:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:3.0:1788744696.642038:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+22:2359:x1875634451201664:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744696.642054:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744696.642068:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392afb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550f6 expref: 22 pid: 5840 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.642082:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392afb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550f6 expref: 22 pid: 5840 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.642106:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:3.0:1788744696.642112:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392baa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.642122:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392baa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.642151:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392baa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744696.642170:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744696.642234:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+22:2359:x1875634451201664:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 197us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744696.642242:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 73 00010000:00010000:1.0:1788744696.642361:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392afb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d550f6 expref: 21 pid: 5840 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744696.642391:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1069b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475314432:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744696.642411:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392baa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.642431:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392baa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.642437:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392baa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.642449:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392baa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.642455:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392baa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.642462:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392baa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.642468:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ec00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744696.642472:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392baa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.642480:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392baa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.642489:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:1.0:1788744696.642492:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744696.642495:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392baa lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.642511:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392baa lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.642522:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392b9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.642527:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392b9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.642533:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392b9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.642538:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744696.642541:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392b9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.642547:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392b9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.642554:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:1.0:1788744696.642556:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788744696.642559:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392b9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.642564:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392b9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744696.642799:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a10751bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+20:11501:x1875634451201408:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 14992us (15136us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1788744696.642809:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 185 00000020:00080000:1.0:1788744696.642820:0:5842:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788744696.643119:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744696.643124:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744696.643657:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:3.0:1788744696.643665:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744696.652685:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744696.653292:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451201920 00000100:00100000:1.0:1788744696.653304:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451201920 00000100:00100000:1.0:1788744696.653370:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:1.0:1788744696.653381:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a210e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+20:11501:x1875634451201920:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788744696.654061:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788744696.654179:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1788744696.654236:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392bb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.654253:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.654265:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.654273:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392bb1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.654280:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392bb1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.654286:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392bb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.654313:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788744696.654412:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a210e3ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+22:11501:x1875634451201920:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 1031us (1732us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788744696.654421:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 50 00000020:00080000:1.0:1788744696.654425:0:5844:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788744696.656012:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744696.656028:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392bb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.656041:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a400 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744696.656045:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392bb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.656054:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392bb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.656071:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93a203446d00) 00010000:00010000:2.0:1788744696.656074:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788744696.656079:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392bb1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.656085:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392bb1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.656190:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744696.656192:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744696.656194:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744696.723854:0:12461:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744696.723865:0:12461:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744696.723918:0:12461:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788744696.723925:0:12461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744696.815522:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744696.815613:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451202176 00000100:00100000:2.0:1788744696.815624:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451202176 00000100:00100000:2.0:1788744696.815695:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 186 00000100:00100000:2.0:1788744696.815706:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+22:11511:x1875634451202176:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744696.815733:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744696.815758:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392bb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5512e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.815866:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb392bbf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.815882:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb392bbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.815896:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb392bbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744696.815908:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788744696.816035:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392bb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5512e expref: 25 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.816053:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb392bbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5512e expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.816062:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:2.0:1788744696.816074:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788744696.816078:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2000, rc 0) 00000100:00100000:2.0:1788744696.816165:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+24:11511:x1875634451202176:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 461us (653us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788744696.816173:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 186 00000100:00100000:0.0:1788744696.829274:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744696.829346:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451202304 00000100:00100000:1.0:1788744696.829361:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451202304 00000100:00100000:1.0:1788744696.829419:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 187 00000100:00100000:1.0:1788744696.829430:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+24:11511:x1875634451202304:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:1.0:1788744696.829529:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392bcd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829548:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392bcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829561:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392bcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829578:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392bd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829586:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829593:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829832:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392bdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829841:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829849:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744696.829890:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829914:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392bcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829920:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392bcd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829928:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392bcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829934:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051ac00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744696.829939:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392bcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829946:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392bcd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829958:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:1.0:1788744696.829961:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744696.829965:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392bcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829971:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392bcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829983:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829989:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392bd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.829995:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.830006:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744696.830009:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.830016:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392bd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.830024:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a203446900) 00010000:00010000:1.0:1788744696.830027:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744696.830030:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392bd4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.830035:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392bd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.830050:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.830057:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392bdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.830063:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392bdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.830069:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744696.830071:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392bdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.830077:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392bdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.830095:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a203446000) 00010000:00010000:1.0:1788744696.830098:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744696.830101:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392bdb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.830107:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392bdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744696.830225:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+24:11511:x1875634451202304:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 796us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744696.830233:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 187 00000100:00100000:3.0:1788744696.874513:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744696.874591:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451202560 00000100:00100000:2.0:1788744696.874601:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451202560 00000100:00100000:2.0:1788744696.874665:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 188 00000100:00100000:2.0:1788744696.874676:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+24:11514:x1875634451202560:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744696.874700:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744696.874722:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392be2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55135 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.874797:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392be9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.874813:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392be9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.874824:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392be9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.874839:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392bf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.874846:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.874853:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875182:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392bf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875193:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875210:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744696.875222:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788744696.875313:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392be9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875321:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392be9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875328:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392be9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875334:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744696.875338:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392be9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875347:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392be9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875358:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:2.0:1788744696.875361:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744696.875366:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392be9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875384:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392be9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875398:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875405:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392bf0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875411:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875416:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744696.875419:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875425:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392bf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875433:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a209e2e100) 00010000:00010000:2.0:1788744696.875436:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744696.875439:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392bf0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875445:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392bf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875487:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392be2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55135 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875500:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55135 expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.875513:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:2.0:1788744696.875516:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744696.875519:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2e00, rc 0) 00000100:00100000:2.0:1788744696.875580:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+26:11514:x1875634451202560:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 905us (1076us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788744696.875587:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 188 00000100:00100000:3.0:1788744696.883943:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744696.884802:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451202688 00000100:00100000:0.0:1788744696.884814:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451202688 00000100:00100000:0.0:1788744696.884882:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 189 00000100:00100000:0.0:1788744696.884893:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+26:11514:x1875634451202688:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:0.0:1788744696.884960:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392c05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.884979:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.884994:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.885027:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392c05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.885035:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392c05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.885044:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392c05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.885052:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ee00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744696.885057:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392c05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.885066:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392c05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.885079:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:0.0:1788744696.885083:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744696.885088:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392c05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.885108:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392c05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744696.885297:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+26:11514:x1875634451202688:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 405us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744696.885305:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 189 00000100:00100000:3.0:1788744696.899679:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744696.899711:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451202944 00000100:00100000:3.0:1788744696.899725:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451202944 00000100:00100000:3.0:1788744696.899771:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:3.0:1788744696.899779:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+26:11514:x1875634451202944:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1788744696.899977:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+27:11514:x1875634451202944:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 199us (308us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788744696.899983:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00010000:00010000:2.0:1788744696.948521:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744696.971971:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744696.972042:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451203200 00000100:00100000:2.0:1788744696.972052:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451203200 00000100:00100000:2.0:1788744696.972115:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 190 00000100:00100000:2.0:1788744696.972125:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+27:11048:x1875634451203200:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788744696.972185:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744696.972217:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392c0c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5513c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.972329:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392c13 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.972345:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392bf7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55135 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.972354:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392c13 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.972388:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55135 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.972421:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392bf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55135 expref: 28 pid: 5840 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744696.972436:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875634475314560:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744696.972542:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204849600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744696.983032:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744696.983215:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875634475314560:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744696.983257:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392c13 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744696.985379:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451203328 00000100:00100000:1.0:1788744696.985396:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451203328 00010000:00010000:1.0:1788744696.985543:0:7626:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392bf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55135 expref: 29 pid: 5840 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744696.985647:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:1.0:1788744696.985658:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c079180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+29:2359:x1875634451203328:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744696.985675:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744696.985684:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392bf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55135 expref: 29 pid: 5840 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.985698:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55135 expref: 29 pid: 5840 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.985722:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392bf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55135 expref: 29 pid: 5840 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.985762:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:1.0:1788744696.985769:0:7626:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392c13 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.985778:0:7626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392c13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.985786:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392c13 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.985822:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744696.985998:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392c13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.986007:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392c13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744696.986029:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788744696.986212:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3600/0x4b162761eb392c0c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5513c expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.986229:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392c13 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5513c expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744696.986236:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:2.0:1788744696.986238:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788744696.986241:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2c00, rc 0) 00000100:00100000:2.0:1788744696.986313:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+29:11048:x1875634451203200:12345-192.168.201.6@tcp:101:bash.0 Request processed in 14189us (14351us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788744696.986332:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 190 00000100:00100000:1.0:1788744696.986511:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c079180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+28:2359:x1875634451203328:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 855us (3488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744696.986518:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:0.0:1788744696.995120:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744696.995221:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451203584 00000100:00100000:1.0:1788744696.995232:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451203584 00000100:00100000:1.0:1788744696.995290:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 191 00000100:00100000:1.0:1788744696.995300:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+28:11048:x1875634451203584:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:1.0:1788744696.995576:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392c21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.995599:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392c21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744696.995612:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392c21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744696.995660:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1788744696.995683:0:5841:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000060b09a2e reply state 00000000701958a9 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392c21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744696.995702:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788744696.995749:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1788744696.995854:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11048:x1875634451203584:12345-192.168.201.6@tcp:36:bash.0 Request processed in 554us (743us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788744696.995861:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 191 00000020:00080000:1.0:1788744696.995866:0:5841:0:(tgt_main.c:545:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788744696.998326:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392c21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.998344:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392c21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.998353:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392c21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.998359:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744696.998364:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392c21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.998372:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392c21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.998390:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:0.0:1788744696.998393:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744696.998398:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392c21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744696.998493:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392c21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744696.999682:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744697.000021:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451203712 00000100:00100000:3.0:1788744697.000032:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451203712 00000100:00100000:3.0:1788744697.000089:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 192 00000100:00100000:3.0:1788744697.000101:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+31:11048:x1875634451203712:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788744697.000125:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744697.000174:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392c28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55143 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.000250:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392c28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55143 expref: 32 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.000265:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392c28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55143 expref: 32 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.000282:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:3.0:1788744697.000285:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744697.000289:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a200031a00, rc 0) 00000100:00100000:3.0:1788744697.000352:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11048:x1875634451203712:12345-192.168.201.6@tcp:101:bash.0 Request processed in 254us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744697.000374:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 192 00000100:00100000:3.0:1788744697.002765:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744697.002958:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451203840 00000100:00100000:2.0:1788744697.002968:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451203840 00000100:00100000:2.0:1788744697.003027:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:2.0:1788744697.003037:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+7:11048:x1875634451203840:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788744697.003056:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744697.003076:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033efbeea/0x4b162761eb392c2f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5514a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744697.003100:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9e13f6, atime: 0x6a9e13f5, ctime: 0x6a9e13f6, blocks: 0xb 00010000:00010000:2.0:1788744697.003121:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=399s v=(0 0) 00010000:00010000:2.0:1788744697.003125:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744697.003164:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033efbeea/0x4b162761eb392c2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5514a expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.003181:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000033efbeea/0x4b162761eb392c2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5514a expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.003194:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3600, rc 0) 00000100:00100000:2.0:1788744697.003265:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+8:11048:x1875634451203840:12345-192.168.201.6@tcp:101:bash.0 Request processed in 229us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744697.003272:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:0.0:1788744697.007260:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744697.007602:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451203968 00000100:00100000:2.0:1788744697.007613:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451203968 00002000:00010000:2.0:1788744697.007660:0:6689:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1788744697.007666:0:6689:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a1078e5880 with x1875634451203968 ext(0->18446744073709551615) 00002000:00010000:2.0:1788744697.007696:0:6689:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93a1078e5880. 00000100:00100000:2.0:1788744697.007737:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:2.0:1788744697.007747:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2359:x1875634451203968:12345-192.168.201.6@tcp:10:bash.0 00002000:00010000:2.0:1788744697.008028:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788744697.008032:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788744694 -> 1788744696 00002000:00010000:2.0:1788744697.008035:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788744693 -> 1788744693 00002000:00010000:2.0:1788744697.008038:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788744694 -> 1788744696 00002000:00010000:2.0:1788744697.008040:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788744697.008273:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2359:x1875634451203968:12345-192.168.201.6@tcp:10:bash.0 Request processed in 526us (1021us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788744697.008282:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00002000:00010000:2.0:1788744697.008286:0:6689:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1788744697.008289:0:6689:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a1078e5880 with x1875634451203968 ext(0->18446744073709551615) 00002000:00010000:2.0:1788744697.008295:0:6689:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93a1078e5880. 00000100:00100000:3.0:1788744697.108208:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744697.108366:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451204096 00000100:00100000:0.0:1788744697.108376:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451204096 00000100:00100000:0.0:1788744697.108480:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 193 00000100:00100000:0.0:1788744697.108493:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11528:x1875634451204096:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:0.0:1788744697.108569:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392c36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.108587:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392c36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.108599:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392c36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.108613:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.108619:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.108625:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.108864:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392c44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.108874:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.108882:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744697.108932:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.108944:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392c36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.108949:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392c36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.108955:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392c36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.108960:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ea00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744697.108965:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392c36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.108972:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392c36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.108984:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:0.0:1788744697.108986:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744697.108992:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392c36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.108998:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392c36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.109010:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.109016:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.109028:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.109033:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744697.109036:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.109042:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.109050:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a203c30700) 00010000:00010000:0.0:1788744697.109052:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744697.109055:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.109060:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.109073:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.109078:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392c44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.109083:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.109088:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ec00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744697.109090:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.109107:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392c44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.109115:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:0.0:1788744697.109117:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744697.109121:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392c44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.109178:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392c44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744697.109270:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11528:x1875634451204096:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 780us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744697.109279:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 193 00000100:00080000:2.0:1788744697.110679:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744697.174912:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744697.174994:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451204352 00000100:00100000:2.0:1788744697.175002:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451204352 00000100:00100000:2.0:1788744697.175048:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 194 00000100:00100000:2.0:1788744697.175055:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+32:11531:x1875634451204352:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744697.175074:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744697.175090:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392c4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55151 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175186:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392c52 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175209:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392c52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175235:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392c52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175250:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392c59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175257:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392c59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175264:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392c59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175707:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392c60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175717:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392c60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175725:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392c60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744697.175736:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788744697.175910:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392c52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175918:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392c52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175925:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392c52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175931:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744697.175943:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392c52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175951:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392c52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175962:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:2.0:1788744697.175965:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744697.175969:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392c52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175975:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392c52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175987:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392c59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175993:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392c59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.175998:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392c59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.176002:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744697.176005:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392c59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.176010:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392c59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.176016:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a209e2e400) 00010000:00010000:2.0:1788744697.176018:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744697.176028:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392c59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.176034:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392c59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.176075:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392c4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55151 expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.176088:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392c60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55151 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.176096:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:2.0:1788744697.176098:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788744697.176100:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2600, rc 0) 00000100:00100000:2.0:1788744697.176329:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+34:11531:x1875634451204352:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1272us (1423us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788744697.176338:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 194 00000100:00100000:1.0:1788744697.180311:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744697.180434:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451204480 00000100:00100000:0.0:1788744697.180445:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451204480 00000100:00100000:0.0:1788744697.180545:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 195 00000100:00100000:0.0:1788744697.180568:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a10751a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+34:11531:x1875634451204480:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:0.0:1788744697.180653:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.180670:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392c13 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5513c expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.180679:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c6e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.180716:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392c13 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5513c expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.180746:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392c13 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5513c expref: 34 pid: 5840 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744697.180761:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1078e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875634475314688:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788744697.180866:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744697.183841:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744697.184019:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451204736 00000100:00100000:3.0:1788744697.184028:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451204736 00000100:00100000:3.0:1788744697.184091:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:3.0:1788744697.184101:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+35:5600:x1875634451204736:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788744697.184650:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+36:5600:x1875634451204736:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 548us (817us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788744697.184658:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:0.0:1788744697.186716:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1078e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875634475314688:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788744697.186754:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744697.186836:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744697.186999:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451204864 00000100:00100000:0.0:1788744697.187008:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451204864 00010000:00010000:0.0:1788744697.187047:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392c13 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5513c expref: 36 pid: 5840 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744697.187092:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00100000:0.0:1788744697.187102:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d438e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+36:2360:x1875634451204864:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744697.187120:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744697.187181:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392c13 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5513c expref: 36 pid: 5840 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.187204:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392c13 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5513c expref: 36 pid: 5840 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.187228:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392c13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5513c expref: 36 pid: 5840 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.187263:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:0.0:1788744697.187268:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.187277:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.187286:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c6e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.187317:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744697.187349:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.187359:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744697.187368:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d438e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+35:2360:x1875634451204864:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 265us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744697.187376:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 75 00010000:00010000:1.0:1788744697.187402:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.187411:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.187417:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.187423:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744697.187428:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.187436:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.187549:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:1.0:1788744697.187560:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744697.187565:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.187572:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392c6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744697.187965:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a10751a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+34:11531:x1875634451204480:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 7409us (7660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744697.187974:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 195 00000100:00100000:0.0:1788744697.191442:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744697.191518:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451205120 00000100:00100000:3.0:1788744697.191528:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451205120 00000100:00100000:3.0:1788744697.191618:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:3.0:1788744697.191630:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+34:11531:x1875634451205120:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1788744697.191944:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+35:11531:x1875634451205120:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 315us (510us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788744697.191952:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:2.0:1788744697.277247:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744697.277393:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451205376 00000100:00100000:3.0:1788744697.277403:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451205376 00000100:00100000:3.0:1788744697.277471:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 196 00000100:00100000:3.0:1788744697.277482:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+35:11542:x1875634451205376:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:3.0:1788744697.277504:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744697.277523:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb392c75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55158 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.277613:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb392c7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.277627:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb392c7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.277640:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb392c7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.277654:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392c83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.277660:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.277666:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278034:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392c8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278044:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278052:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392c8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744697.278063:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788744697.278347:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb392c7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278367:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb392c7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278374:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb392c7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278380:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200031e00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744697.278385:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb392c7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278393:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb392c7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278406:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744697.278409:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744697.278416:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb392c7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278422:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031e00/0x4b162761eb392c7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278437:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278509:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392c83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278516:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392c83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278521:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a200030c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744697.278530:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392c83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278537:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392c83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278546:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a21a9aee00) 00010000:00010000:3.0:1788744697.278549:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744697.278552:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392c83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278558:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030c00/0x4b162761eb392c83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278618:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030800/0x4b162761eb392c75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55158 expref: 38 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278632:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392c8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55158 expref: 37 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.278639:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:3.0:1788744697.278641:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744697.278644:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80c00, rc 0) 00000100:00100000:3.0:1788744697.278834:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+37:11542:x1875634451205376:12345-192.168.201.6@tcp:101:cat.0 Request processed in 1351us (1593us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788744697.278843:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 196 00000100:00100000:0.0:1788744697.284415:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.284600:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451205632 00000100:00100000:1.0:1788744697.284611:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451205632 00000100:00100000:1.0:1788744697.284669:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:1.0:1788744697.284678:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+37:11542:x1875634451205632:12345-192.168.201.6@tcp:35:cat.0 00000100:00100000:1.0:1788744697.284944:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+38:11542:x1875634451205632:12345-192.168.201.6@tcp:35:cat.0 Request processed in 266us (540us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788744697.284952:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:0.0:1788744697.302523:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.302676:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451205888 00000100:00100000:1.0:1788744697.302689:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451205888 00000100:00100000:1.0:1788744697.302762:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 197 00000100:00100000:1.0:1788744697.302773:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+38:11543:x1875634451205888:12345-192.168.201.6@tcp:36:rm.0 00010000:00010000:1.0:1788744697.302835:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788744697.302863:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80c00/0x4b162761eb392c8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55158 expref: 38 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.302890:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392c60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55151 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.302927:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031a00/0x4b162761eb392c28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55143 expref: 36 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.302938:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:1.0:1788744697.302949:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744697.302971:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392c98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.302983:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392c98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.302992:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392c98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.303005:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392c9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.303012:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.303018:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.303324:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392ca6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.303333:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.303341:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744697.304989:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:1.0:1788744697.305080:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392cad lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305096:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392cad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305109:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392cad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305117:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392cad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305357:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392cad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305365:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392cad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305550:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744697.305579:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305587:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392ca6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305593:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392ca6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305600:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051aa00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744697.305605:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392ca6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305623:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392ca6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305636:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a203446900) 00010000:00010000:1.0:1788744697.305639:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788744697.305645:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392ca6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305651:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051aa00/0x4b162761eb392ca6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305672:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392c98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305678:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392c98 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305684:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392c98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305689:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051ac00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744697.305692:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392c98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305698:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392c98 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305705:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:1.0:1788744697.305707:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744697.305710:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392c98 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.305727:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb392c98 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744697.305738:0:5842:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000e20c7239 reply state 00000000cb7e43fc transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744697.305760:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788744697.305862:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+37:11543:x1875634451205888:12345-192.168.201.6@tcp:36:rm.0 Request processed in 3087us (3350us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788744697.305871:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 197 00010000:00010000:0.0:1788744697.308462:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744697.308478:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392cad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.308490:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051ae00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744697.308496:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392cad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.308506:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392cad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.308524:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93a203446900) 00010000:00010000:0.0:1788744697.308545:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788744697.308552:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392cad lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.308558:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392cad lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.308587:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744697.308589:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744697.308591:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744697.311035:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.311053:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392c9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.311077:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392c9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.311085:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744697.311091:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392c9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.311099:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392c9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.311114:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a203446000) 00010000:00010000:3.0:1788744697.311117:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744697.311122:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392c9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.311160:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392c9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744697.356992:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744697.357089:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451206144 00000100:00100000:2.0:1788744697.357101:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451206144 00000100:00100000:2.0:1788744697.357201:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 198 00000100:00100000:2.0:1788744697.357211:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+36:11549:x1875634451206144:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788744697.357237:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744697.357258:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392cb4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5515f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.357367:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392cbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.357396:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392cbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.357408:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392cbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.357424:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392cc2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.357431:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.357437:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744697.358086:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788744697.358436:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392cc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.358574:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.358583:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.358621:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392cbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.358628:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392cbb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.358635:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392cbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.358650:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744697.358654:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392cbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.358661:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392cbb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.358672:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:2.0:1788744697.358675:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744697.358680:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392cbb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.358685:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392cbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744697.358697:0:5840:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000002db9b10d reply state 00000000ae66c4ff transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744697.358705:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788744697.358735:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb392cb4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5515f expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.358749:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5515f expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.358756:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:2.0:1788744697.358758:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744697.358760:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2600, rc 0) 00000100:00100000:2.0:1788744697.359048:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+39:11549:x1875634451206144:12345-192.168.201.6@tcp:101:bash.0 Request processed in 1837us (2065us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788744697.359062:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 198 00010000:00010000:0.0:1788744697.367930:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.368359:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392cc2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.368370:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392cc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.368378:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744697.368383:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392cc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.368392:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392cc2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.368412:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a209e2e400) 00010000:00010000:0.0:1788744697.368415:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744697.368421:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392cc2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.368429:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb392cc2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744697.369719:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744697.370000:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451206272 00000100:00100000:3.0:1788744697.370011:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451206272 00000100:00100000:3.0:1788744697.370323:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:3.0:1788744697.370335:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2359:x1875634451206272:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788744697.370358:0:9032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744697.370381:0:9032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392cd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55166 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744697.370411:0:9032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744697.370431:0:9032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=400s v=(0 0) 00010000:00010000:3.0:1788744697.370459:0:9032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744697.370469:0:9032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392cd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55166 expref: 6 pid: 9032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.370490:0:9032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392cd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55166 expref: 6 pid: 9032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.370503:0:9032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80800, rc 0) 00000100:00100000:3.0:1788744697.370567:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451206272:12345-192.168.201.6@tcp:101:bash.0 Request processed in 235us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744697.370574:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:2.0:1788744697.373607:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744697.373773:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451206400 00000100:00100000:3.0:1788744697.373784:0:12018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451206400 00000100:00100000:3.0:1788744697.374056:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:3.0:1788744697.374068:0:12018:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+6:11549:x1875634451206400:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788744697.374087:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744697.374106:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5516d expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.374178:0:12018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392cd7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55166 expref: 7 pid: 9032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.374198:0:12018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744697.374203:0:12018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744697.374209:0:12018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5516d expref: 7 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.374261:0:12018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392cd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55166 expref: 7 pid: 9032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.374275:0:12018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392cd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55166 expref: 7 pid: 9032 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744697.374290:0:12018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12018:1875634475314816:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788744697.374375:0:12018:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20489e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788744697.378304:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744697.378452:0:12018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12018:1875634475314816:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744697.378487:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5516d expref: 7 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.378510:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81800, rc 0) 00000100:00100000:3.0:1788744697.378580:0:12018:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+7:11549:x1875634451206400:12345-192.168.201.6@tcp:101:bash.0 Request processed in 4515us (4982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744697.378590:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:0.0:1788744697.378728:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451206528 00000100:00100000:0.0:1788744697.378736:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451206528 00010000:00010000:0.0:1788744697.378769:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392cd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55166 expref: 7 pid: 9032 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744697.378872:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:0.0:1788744697.378883:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20d763c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2360:x1875634451206528:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744697.378899:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744697.378925:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392cd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55166 expref: 7 pid: 9032 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.378940:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392cd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55166 expref: 7 pid: 9032 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.378965:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076b25ec9/0x4b162761eb392cd7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55166 expref: 7 pid: 9032 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.378980:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744697.378985:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744697.378992:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5516d expref: 6 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.379003:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5516d expref: 6 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.379061:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5516d expref: 6 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744697.379076:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1078e4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5827:1875634475314944:192.168.201.6@tcp:105: 00000100:00100000:0.0:1788744697.379636:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744697.382317:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1078e4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5827:1875634475314944:192.168.201.6@tcp:105: 00010000:00010000:1.0:1788744697.382348:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744697.382531:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20d763c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2360:x1875634451206528:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 3649us (4240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744697.382543:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:2.0:1788744697.387501:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.387599:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451206784 00000100:00100000:1.0:1788744697.387609:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451206784 00000100:00100000:1.0:1788744697.387700:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:1.0:1788744697.387712:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+38:11549:x1875634451206784:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:1.0:1788744697.388108:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+39:11549:x1875634451206784:12345-192.168.201.6@tcp:35:bash.0 Request processed in 397us (616us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788744697.388117:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:2.0:1788744697.542484:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744697.542615:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451206912 00000100:00100000:0.0:1788744697.542625:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451206912 00000100:00100000:0.0:1788744697.542742:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 199 00000100:00100000:0.0:1788744697.542754:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+39:11565:x1875634451206912:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788744697.542780:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744697.542803:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392ce5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55174 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.542871:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392cec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.542886:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.542897:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744697.542930:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788744697.542933:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744697.542951:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.542976:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392ce5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55174 expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.543013:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392cec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55174 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.543022:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:0.0:1788744697.543025:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744697.543029:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17f200, rc 0) 00000100:00100000:0.0:1788744697.543099:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+40:11565:x1875634451206912:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 347us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744697.543107:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 199 00000100:00100000:0.0:1788744697.550367:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744697.551618:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451207168 00000100:00100000:3.0:1788744697.551634:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451207168 00000100:00100000:3.0:1788744697.551742:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 200 00000100:00100000:3.0:1788744697.551754:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+40:11565:x1875634451207168:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788744697.551776:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744697.551801:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392cf3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5517b expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.551932:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392cfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.551948:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.551962:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744697.551974:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788744697.552102:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392cf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5517b expref: 43 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.552122:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392cfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5517b expref: 42 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.552160:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:3.0:1788744697.552164:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744697.552167:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80800, rc 0) 00000100:00100000:3.0:1788744697.552264:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+42:11565:x1875634451207168:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 512us (1906us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788744697.552271:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 200 00000100:00100000:2.0:1788744697.561898:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744697.561938:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.562017:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451207424 00000100:00100000:1.0:1788744697.562030:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451207424 00000100:00100000:1.0:1788744697.562089:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 201 00000100:00100000:1.0:1788744697.562117:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+42:11565:x1875634451207424:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788744697.562171:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744697.562204:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392d08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55182 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.562326:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.562342:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.562353:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744697.562366:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788744697.562487:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a600/0x4b162761eb392d08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55182 expref: 45 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.562505:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55182 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.562513:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:1.0:1788744697.562516:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788744697.562520:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051bc00, rc 0) 00000100:00100000:1.0:1788744697.562583:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+44:11565:x1875634451207424:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 468us (694us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788744697.562590:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 201 00000100:00100000:3.0:1788744697.562816:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451207552 00000100:00100000:3.0:1788744697.562822:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451207552 00000100:00100000:3.0:1788744697.562865:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:3.0:1788744697.562873:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+44:2362:x1875634451207552:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744697.562884:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744697.562908:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb392cfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5517b expref: 44 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.562921:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:3.0:1788744697.562924:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744697.562952:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+43:2362:x1875634451207552:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 81us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744697.562959:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:2.0:1788744697.569825:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744697.569920:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451207680 00000100:00100000:0.0:1788744697.569932:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451207680 00000100:00100000:0.0:1788744697.570037:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:0.0:1788744697.570048:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+6:2359:x1875634451207680:12345-192.168.201.6@tcp:1:lfs.0 00010000:00010000:0.0:1788744697.570100:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f60bc23f/0x4b162761eb392d1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.570122:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5516d expref: 6 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.570168:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744697.570174:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744697.570178:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f60bc23f/0x4b162761eb392d1d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.570227:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5516d expref: 6 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.570259:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5516d expref: 6 pid: 12018 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744697.570276:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1078e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1875634475315072:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788744697.570361:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788744697.573202:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.573334:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451207808 00000100:00100000:1.0:1788744697.573345:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451207808 00002000:00100000:1.0:1788744697.573407:0:6688:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93a23d438700 x1875634451207808/t0(0) o4->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:218/0 lens 504/0 e 0 to 0 dl 1788744708 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744697.573420:0:6688:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a23d438700 with x1875634451207808 ext(0->8) 00010000:00010000:1.0:1788744697.573431:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5516d expref: 7 pid: 12018 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.573449:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5516d expref: 7 pid: 12018 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744697.573457:0:6688:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93a23d438700 00000100:00100000:1.0:1788744697.573488:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:1.0:1788744697.573498:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2360:x1875634451207808:12345-192.168.201.6@tcp:4:lfs.0 00000100:00100000:1.0:1788744697.573909:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2360:x1875634451207808:12345-192.168.201.6@tcp:4:lfs.0 Request processed in 411us (727us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788744697.573918:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00002000:00100000:1.0:1788744697.573925:0:6688:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93a23d438700 x1875634451207808/t4294967308(0) o4->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:218/0 lens 504/448 e 0 to 0 dl 1788744708 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744697.573933:0:6688:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a23d438700 with x1875634451207808 ext(0->8) 00010000:00010000:1.0:1788744697.573940:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5516d expref: 9 pid: 12018 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.573951:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5516d expref: 9 pid: 12018 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744697.573959:0:6688:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff93a23d438700 00000100:00100000:0.0:1788744697.574068:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1078e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6685:1875634475315072:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788744697.574092:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f60bc23f/0x4b162761eb392d1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744697.576366:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744697.576409:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451207936 00000100:00100000:3.0:1788744697.576419:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451207936 00010000:00010000:3.0:1788744697.576560:0:7626:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5516d expref: 9 pid: 12018 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744697.576603:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:3.0:1788744697.576613:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2360:x1875634451207936:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744697.576628:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788744697.576647:0:7626:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788744697.576650:0:7626:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788744696 00002000:00010000:3.0:1788744697.576653:0:7626:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788744696 00002000:00010000:3.0:1788744697.576655:0:7626:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788744696 00010000:00010000:3.0:1788744697.576661:0:7626:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5516d expref: 9 pid: 12018 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.576674:0:7626:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5516d expref: 9 pid: 12018 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.576740:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c89ef1c/0x4b162761eb392cde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5516d expref: 9 pid: 12018 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.576758:0:7626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744697.576762:0:7626:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744697.576768:0:7626:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f60bc23f/0x4b162761eb392d1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.576779:0:7626:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f60bc23f/0x4b162761eb392d1d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.576995:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744697.577051:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2360:x1875634451207936:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 439us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744697.577059:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 77 00010000:00010000:0.0:1788744697.577430:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f60bc23f/0x4b162761eb392d1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.577445:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f60bc23f/0x4b162761eb392d1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.577555:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f60bc23f/0x4b162761eb392d1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.577565:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f60bc23f/0x4b162761eb392d1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.577573:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f60bc23f/0x4b162761eb392d1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.577601:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f600 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744697.577606:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f60bc23f/0x4b162761eb392d1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.577615:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f60bc23f/0x4b162761eb392d1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.577630:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f60bc23f/0x4b162761eb392d1d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.577638:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f60bc23f/0x4b162761eb392d1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744697.577705:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2359:x1875634451207680:12345-192.168.201.6@tcp:1:lfs.0 Request processed in 7659us (7891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744697.577714:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:1.0:1788744697.586983:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744697.587066:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451208192 00000100:00100000:3.0:1788744697.587170:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451208192 00000100:00100000:1.0:1788744697.588619:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:1.0:1788744697.588643:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a210df5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+43:11565:x1875634451208192:12345-192.168.201.6@tcp:35:lfs.0 00000004:00010000:1.0:1788744697.588732:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55182 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744697.590073:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788744697.590101:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788744697.591106:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788744697.591221:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.591426:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392cc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5515f expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.591889:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d24 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.591934:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5515f expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.591948:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5515f expref: 47 pid: 5840 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744697.591960:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a10751b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1875634475315200:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744697.592061:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204c06540 going to sleep for 11 seconds 00000100:00100000:3.0:1788744697.598881:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744697.599098:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451208320 00000100:00100000:0.0:1788744697.599109:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451208320 00010000:00010000:0.0:1788744697.599202:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392cc9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5515f expref: 48 pid: 5840 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744697.599221:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a10751b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1875634475315200:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744697.599267:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744697.599314:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:2.0:1788744697.599327:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d439c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+48:2359:x1875634451208320:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744697.599345:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744697.599353:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5515f expref: 48 pid: 5840 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.599366:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5515f expref: 48 pid: 5840 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.599389:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392cc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5515f expref: 48 pid: 5840 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.599405:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:2.0:1788744697.599410:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.599419:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.599426:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d24 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.599468:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744697.599527:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d439c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+47:2359:x1875634451208320:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 203us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744697.599535:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 78 00010000:00010000:1.0:1788744697.599655:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.599662:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744697.599792:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788744697.600081:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1788744697.600636:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a10751b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875634475315328:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788744697.600689:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744697.600760:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204c066c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744697.604538:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475315328 00000100:00100000:2.0:1788744697.604554:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475315328 00000100:00100000:2.0:1788744697.604612:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788744697.604622:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1875634475315328:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788744697.604764:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1875634475315328:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 144us (4074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744697.604772:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744697.604922:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a10751b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875634475315328:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788744697.605459:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788744697.605544:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a10751b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875634475315456:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788744697.605586:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744697.607556:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23ccd66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744697.608415:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475315456 00000100:00100000:3.0:1788744697.608426:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475315456 00000100:00100000:3.0:1788744697.608477:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744697.608485:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1875634475315456:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788744697.608760:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5844:x1875634475315456:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 275us (3173us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788744697.608768:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788744697.608906:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a10751b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1875634475315456:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788744697.608986:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788744697.609032:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.609043:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d24 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.609051:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.609073:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744697.609077:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.609085:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d24 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.609099:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:1.0:1788744697.609102:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788744697.609107:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d24 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.609113:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d24 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788744697.609557:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788744697.609654:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788744697.609667:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400308536420ns, next at 401308533678ns, rc = 0 00000001:00080000:1.0:1788744697.609673:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788744697.609705:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:1.0:1788744697.609708:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788744697.609715:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55182 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744697.609849:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a210df5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+50:11565:x1875634451208192:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 21217us (22877us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788744697.609857:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 56 00000020:00080000:1.0:1788744697.609861:0:5844:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788744697.613728:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744697.613807:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451208448 00000100:00100000:2.0:1788744697.613816:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451208448 00000100:00100000:2.0:1788744697.613871:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 202 00000100:00100000:2.0:1788744697.613880:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+50:11565:x1875634451208448:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744697.613903:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744697.613937:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392d2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55189 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.613996:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392d2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55189 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.614010:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392d2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55189 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.614027:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:2.0:1788744697.614036:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744697.614040:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2600, rc 0) 00000100:00100000:2.0:1788744697.616899:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+51:11565:x1875634451208448:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 3004us (3164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744697.616922:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 202 00000100:00100000:3.0:1788744697.621181:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744697.621504:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451208704 00000100:00100000:2.0:1788744697.621516:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451208704 00000100:00100000:2.0:1788744697.621565:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:2.0:1788744697.621572:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+51:11565:x1875634451208704:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:2.0:1788744697.622073:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+52:11565:x1875634451208704:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 499us (943us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1788744697.622083:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 57 00000040:00080000:3.0:1788744697.652450:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744697.652460:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744697.652668:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788744697.652675:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788744697.720755:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.720848:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451208832 00000100:00100000:1.0:1788744697.720858:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451208832 00000100:00100000:1.0:1788744697.720917:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 203 00000100:00100000:1.0:1788744697.720928:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+52:11575:x1875634451208832:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:1.0:1788744697.721025:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d32 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721043:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721056:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721072:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721080:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721087:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721236:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721246:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721254:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744697.721296:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721325:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721332:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721341:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721347:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051bc00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744697.721351:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721359:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721372:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:1.0:1788744697.721375:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744697.721380:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721386:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721400:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721406:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721412:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721424:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744697.721427:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721434:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721442:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a203446200) 00010000:00010000:1.0:1788744697.721444:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744697.721447:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721452:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721468:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721474:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721480:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721485:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051ae00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744697.721488:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721494:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721513:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:1.0:1788744697.721515:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744697.721519:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.721525:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744697.721709:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+52:11575:x1875634451208832:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 781us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744697.721717:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 203 00000100:00100000:0.0:1788744697.759405:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.759518:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451209088 00000100:00100000:1.0:1788744697.759529:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451209088 00000100:00100000:1.0:1788744697.759594:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 204 00000100:00100000:1.0:1788744697.759604:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+52:11578:x1875634451209088:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788744697.759625:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744697.759647:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55190 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.759722:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.759736:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.759748:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.759764:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.759788:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.759810:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.759942:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392d5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.759951:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.759957:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744697.759968:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788744697.760074:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.760082:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.760089:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.760096:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744697.760100:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.760108:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.760171:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:1.0:1788744697.760175:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744697.760181:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.760199:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392d4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.760214:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.760220:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.760226:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.760231:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051bc00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744697.760234:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.760240:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.760248:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a203446200) 00010000:00010000:1.0:1788744697.760250:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744697.760253:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.760258:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.760313:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55190 expref: 55 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.760328:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392d5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55190 expref: 54 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.760336:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:1.0:1788744697.760338:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744697.760340:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051b200, rc 0) 00000100:00100000:1.0:1788744697.760394:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+54:11578:x1875634451209088:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 791us (1000us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788744697.760401:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 204 00000100:00100000:0.0:1788744697.764476:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.764545:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451209216 00000100:00100000:1.0:1788744697.764556:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451209216 00000100:00100000:1.0:1788744697.764617:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 205 00000100:00100000:1.0:1788744697.764626:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+54:11578:x1875634451209216:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:1.0:1788744697.764696:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392d6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.764713:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.764724:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.764749:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.764772:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392d6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.764779:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392d6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.764786:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744697.764801:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392d6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.764809:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392d6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.764821:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:1.0:1788744697.764831:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744697.764836:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392d6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.764842:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392d6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744697.764915:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+54:11578:x1875634451209216:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 289us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744697.764922:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 205 00000100:00100000:0.0:1788744697.767443:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.767526:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451209472 00000100:00100000:1.0:1788744697.767537:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451209472 00000100:00100000:1.0:1788744697.767627:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:1.0:1788744697.767637:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+54:11578:x1875634451209472:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788744697.767951:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+55:11578:x1875634451209472:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 314us (515us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788744697.767973:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:0.0:1788744697.842651:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.842761:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451209728 00000100:00100000:1.0:1788744697.842772:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451209728 00000100:00100000:1.0:1788744697.842839:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 206 00000100:00100000:1.0:1788744697.842849:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+55:11588:x1875634451209728:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1788744697.842871:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744697.842875:0:11306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788744697.842901:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392cec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55174 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.842920:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:1.0:1788744697.842925:0:11306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744697.842940:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392d71 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55197 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.843039:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.843053:0:11306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392d5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55190 expref: 55 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.843061:0:11306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d78 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.843095:0:11306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392d5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55190 expref: 55 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.843108:0:11306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392d5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55190 expref: 55 pid: 11306 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744697.843189:0:11306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a10751b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475315584:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744697.843311:0:11306:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2109be540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744697.846562:0:11306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a10751b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475315584:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744697.846598:0:11306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744697.847873:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.848242:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451209856 00000100:00100000:1.0:1788744697.848253:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451209856 00010000:00010000:1.0:1788744697.848293:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392d5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55190 expref: 56 pid: 11306 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744697.848337:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:1.0:1788744697.848347:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+56:2359:x1875634451209856:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744697.848363:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744697.848380:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392d5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55190 expref: 56 pid: 11306 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.848393:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392d5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55190 expref: 56 pid: 11306 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.848416:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392d5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55190 expref: 56 pid: 11306 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.848442:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:1.0:1788744697.848448:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.848471:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.848479:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d78 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.848517:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744697.848576:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+55:2359:x1875634451209856:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 230us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744697.848584:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 79 00010000:00010000:2.0:1788744697.848748:0:11306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.848757:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744697.848779:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788744697.848921:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a200/0x4b162761eb392d71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55197 expref: 56 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.848937:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55197 expref: 55 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.848944:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:2.0:1788744697.848947:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788744697.848950:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051ae00, rc 0) 00000100:00100000:2.0:1788744697.848983:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+55:11588:x1875634451209728:12345-192.168.201.6@tcp:101:bash.0 Request processed in 6136us (6342us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788744697.848991:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 206 00000100:00100000:0.0:1788744697.851116:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.851249:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451210112 00000100:00100000:1.0:1788744697.851258:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451210112 00000100:00100000:1.0:1788744697.851300:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 207 00000100:00100000:1.0:1788744697.851309:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+55:11588:x1875634451210112:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:1.0:1788744697.851693:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.851709:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.851720:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744697.851765:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1788744697.851786:0:5842:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000076881077 reply state 00000000643bbb9a transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744697.851794:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788744697.851881:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+58:11588:x1875634451210112:12345-192.168.201.6@tcp:36:bash.0 Request processed in 571us (773us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788744697.851905:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 207 00000020:00080000:1.0:1788744697.851910:0:5842:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788744697.853994:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.854011:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.854020:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.854026:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051bc00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744697.854031:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.854038:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d86 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.854053:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:3.0:1788744697.854056:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744697.854061:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d86 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744697.854066:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051bc00/0x4b162761eb392d86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744697.855839:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744697.855932:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451210240 00000100:00100000:2.0:1788744697.855944:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451210240 00000100:00100000:2.0:1788744697.856006:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 208 00000100:00100000:2.0:1788744697.856017:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+57:11588:x1875634451210240:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788744697.856039:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744697.856059:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392d8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5519e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.856210:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.856224:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d78 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55197 expref: 58 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.856247:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.856280:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55197 expref: 58 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.856294:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55197 expref: 58 pid: 11306 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744697.856307:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875634475315712:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744697.856760:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204849600 going to sleep for 11 seconds 00000100:00100000:2.0:1788744697.858877:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1875634475315712:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744697.858906:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744697.859996:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744697.860310:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451210368 00000100:00100000:2.0:1788744697.860320:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451210368 00010000:00010000:2.0:1788744697.860360:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55197 expref: 59 pid: 11306 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744697.860406:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:2.0:1788744697.860416:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+59:2360:x1875634451210368:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744697.860440:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744697.860448:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55197 expref: 59 pid: 11306 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.860461:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55197 expref: 59 pid: 11306 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.860484:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ae00/0x4b162761eb392d78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55197 expref: 59 pid: 11306 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.860501:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:2.0:1788744697.860506:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.860516:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.860524:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.860569:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744697.860688:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.860697:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744697.860749:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788744697.860754:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744697.860776:0:5840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.860816:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb392d8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5519e expref: 59 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.860832:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5519e expref: 58 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.860840:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:1.0:1788744697.860843:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744697.860845:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3400, rc 0) 00000100:00100000:2.0:1788744697.860890:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+58:2360:x1875634451210368:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 474us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744697.860898:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:1.0:1788744697.861746:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+57:11588:x1875634451210240:12345-192.168.201.6@tcp:101:bash.0 Request processed in 5728us (5912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744697.861754:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 208 00000100:00100000:3.0:1788744697.864986:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744697.865052:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451210624 00000100:00100000:2.0:1788744697.865062:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451210624 00000100:00100000:2.0:1788744697.865120:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:2.0:1788744697.865172:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+57:11588:x1875634451210624:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:2.0:1788744697.865843:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+58:11588:x1875634451210624:12345-192.168.201.6@tcp:35:bash.0 Request processed in 672us (865us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788744697.865852:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:3.0:1788744697.911991:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744697.912115:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451210752 00000100:00100000:2.0:1788744697.912170:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451210752 00000100:00100000:2.0:1788744697.912244:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 209 00000100:00100000:2.0:1788744697.912255:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+58:11594:x1875634451210752:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744697.912281:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744697.912303:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392d9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d551a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.912368:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392da2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.912382:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.912393:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744697.912446:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788744697.912450:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744697.912466:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.912489:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392d9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551a5 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.912507:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392da2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551a5 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744697.912514:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:2.0:1788744697.912517:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744697.912521:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3c00, rc 0) 00000100:00100000:2.0:1788744697.912570:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+59:11594:x1875634451210752:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 317us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744697.912577:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 209 00000100:00100000:0.0:1788744697.915991:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.916074:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451210880 00000100:00100000:1.0:1788744697.916084:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451210880 00000100:00100000:1.0:1788744697.916178:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 210 00000100:00100000:1.0:1788744697.916200:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+59:11594:x1875634451210880:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788744697.916228:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744697.916249:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392da9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d551ac expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916311:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392db0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916325:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392db0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916335:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392db0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916349:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392db7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916355:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392db7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916362:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392db7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916447:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916456:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916463:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744697.916495:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788744697.916507:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744697.916530:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916541:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916549:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392db0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916556:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392db0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916563:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392db0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916569:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744697.916573:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392db0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916581:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392db0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916592:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:1.0:1788744697.916595:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744697.916600:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392db0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916606:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb392db0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916618:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392db7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916636:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392db7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916642:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392db7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916647:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744697.916649:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392db7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916656:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392db7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916664:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a203446200) 00010000:00010000:1.0:1788744697.916667:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744697.916670:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392db7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916676:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b000/0x4b162761eb392db7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916708:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392da9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551ac expref: 61 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916720:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551ac expref: 60 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.916727:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:1.0:1788744697.916729:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744697.916738:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051a400, rc 0) 00000100:00100000:1.0:1788744697.916801:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+60:11594:x1875634451210880:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 604us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744697.916809:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 210 00000100:00100000:0.0:1788744697.920631:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.920705:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451211008 00000100:00100000:1.0:1788744697.920715:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451211008 00000100:00100000:1.0:1788744697.920782:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:1.0:1788744697.920794:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+60:2359:x1875634451211008:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744697.920812:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744697.920838:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551ac expref: 60 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.920858:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:1.0:1788744697.920863:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744697.920921:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+59:2359:x1875634451211008:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 131us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744697.920928:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:3.0:1788744697.923365:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744697.923614:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451211264 00000100:00100000:0.0:1788744697.923624:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451211264 00000100:00100000:0.0:1788744697.923681:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 211 00000100:00100000:0.0:1788744697.923692:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+59:11594:x1875634451211264:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788744697.923716:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744697.923740:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392dc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d551b3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.923854:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392dcc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.923870:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5519e expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.923880:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392dcc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.923919:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5519e expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.923932:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5519e expref: 60 pid: 5840 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744697.923959:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d13ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875634475315840:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788744697.924056:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788744697.926905:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d13ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875634475315840:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744697.926935:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392dcc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744697.927508:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744697.927883:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451211392 00000100:00100000:0.0:1788744697.927892:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451211392 00010000:00010000:0.0:1788744697.927935:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5519e expref: 61 pid: 5840 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744697.927974:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:0.0:1788744697.927984:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20d762450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+61:2360:x1875634451211392:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744697.928000:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744697.928007:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5519e expref: 61 pid: 5840 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.928019:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5519e expref: 61 pid: 5840 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.928044:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3400/0x4b162761eb392d94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5519e expref: 61 pid: 5840 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.928059:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:0.0:1788744697.928064:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392dcc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.928073:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392dcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.928096:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392dcc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744697.928292:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744697.928355:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20d762450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+60:2360:x1875634451211392:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 371us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744697.928364:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 81 00010000:00010000:1.0:1788744697.929623:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392dcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.929636:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392dcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744697.929658:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788744697.929815:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392dc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551b3 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.929837:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392dcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551b3 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.929845:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:1.0:1788744697.929848:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788744697.929851:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17ea00, rc 0) 00000100:00100000:1.0:1788744697.929940:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+60:11594:x1875634451211264:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 6249us (6584us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788744697.929949:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 211 00000100:00100000:3.0:1788744697.933232:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.933335:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451211648 00000100:00100000:1.0:1788744697.933345:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451211648 00000100:00100000:1.0:1788744697.933420:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:1.0:1788744697.933440:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+60:11594:x1875634451211648:12345-192.168.201.6@tcp:103:lfs.0 00010000:00010000:1.0:1788744697.933457:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744697.933482:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2600/0x4b162761eb392d2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55189 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.933500:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:1.0:1788744697.933505:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744697.933554:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+59:11594:x1875634451211648:12345-192.168.201.6@tcp:103:lfs.0 Request processed in 125us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744697.933561:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:0.0:1788744697.942404:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.942491:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451211776 00000100:00100000:1.0:1788744697.942505:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451211776 00000100:00100000:1.0:1788744697.942586:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 212 00000100:00100000:1.0:1788744697.942597:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+59:11594:x1875634451211776:12345-192.168.201.6@tcp:58:lfs.0 00010000:00010000:1.0:1788744697.942705:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dda lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.942723:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.942735:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744697.942913:0:11306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788744697.943005:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+59:11594:x1875634451211776:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 409us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744697.943013:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 212 00000100:00100000:0.0:1788744697.946673:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744697.946768:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451211904 00000100:00100000:1.0:1788744697.946777:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451211904 00000100:00100000:1.0:1788744697.946835:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 213 00000100:00100000:1.0:1788744697.946845:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+59:11594:x1875634451211904:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788744697.946865:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744697.946888:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392de1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d551ba expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.946945:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dda lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.946957:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392de1 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551ba expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.946990:0:5842:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.947003:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392de1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551ba expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.947015:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:1.0:1788744697.947018:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744697.947022:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392de1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551ba expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744697.947029:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051b200, rc 0) 00000100:00100000:1.0:1788744697.947089:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+60:11594:x1875634451211904:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 246us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744697.947096:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 213 00010000:00010000:2.0:1788744697.972691:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788744698.677228:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744698.677235:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744698.677277:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788744698.677283:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744698.678093:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d56b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875634475315968:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744698.678244:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20489e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744698.698634:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744698.699219:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451212032 00000100:00100000:1.0:1788744698.699231:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451212032 00000100:00100000:1.0:1788744698.699300:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 214 00000100:00100000:2.0:1788744698.699319:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d56b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875634475315968:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788744698.699319:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+61:11595:x1875634451212032:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788744698.699373:0:11306:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788744698.699640:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+60:11595:x1875634451212032:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 325us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744698.699649:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 214 00000100:00100000:1.0:1788744698.707917:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744698.710238:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451212160 00000100:00100000:0.0:1788744698.710253:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451212160 00000100:00100000:0.0:1788744698.710333:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 215 00000100:00100000:0.0:1788744698.710344:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a10751b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+60:11595:x1875634451212160:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788744698.710428:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392de8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710446:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392de8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710459:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392de8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710475:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392def lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710482:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392def lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710488:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392def lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710525:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392df6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710534:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710540:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744698.710592:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788744698.710597:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744698.710611:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710620:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392de8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710627:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392de8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710634:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392de8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710641:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ee00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744698.710645:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392de8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710652:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392de8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710663:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93a203446f00) 00010000:00010000:0.0:1788744698.710672:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744698.710677:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392de8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710683:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392de8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710698:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392def lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710704:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392def lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710709:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392def lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.710714:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744698.710993:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392def lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.711002:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392def lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.711010:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff93a203c30700) 00010000:00010000:0.0:1788744698.711013:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744698.711017:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392def lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.711022:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392def lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.711040:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392df6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.711053:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392df6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.711059:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392df6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.711064:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744698.711067:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392df6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.711074:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392df6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.711082:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:0.0:1788744698.711085:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744698.711088:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392df6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.711093:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392df6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744698.711217:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a10751b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+60:11595:x1875634451212160:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 Request processed in 872us (3308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744698.711226:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 215 00000100:00100000:3.0:1788744698.714917:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744698.715001:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451212416 00000100:00100000:0.0:1788744698.715011:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451212416 00000100:00100000:0.0:1788744698.715071:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 216 00000100:00100000:0.0:1788744698.715082:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+60:11595:x1875634451212416:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744698.715103:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744698.715184:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392dfd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d551c1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.715297:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.715313:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.715326:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744698.715338:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788744698.715451:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.715459:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.715465:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.715471:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744698.715475:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.715481:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.715493:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:0.0:1788744698.715496:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788744698.715501:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.715518:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.715818:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392dfd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551c1 expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.715832:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93a203446f00) 00010000:00010000:0.0:1788744698.715835:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744698.715839:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392dfd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551c1 expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.715851:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17ec00, rc 0) 00000100:00100000:0.0:1788744698.715960:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+61:11595:x1875634451212416:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 879us (1052us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788744698.715968:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 216 00000100:00100000:3.0:1788744698.726116:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744698.726258:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451212544 00000100:00100000:0.0:1788744698.726268:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451212544 00000100:00100000:0.0:1788744698.726318:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 217 00000100:00100000:0.0:1788744698.726328:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+61:11595:x1875634451212544:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788744698.726372:0:5842:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788744698.726489:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+61:11595:x1875634451212544:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 161us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744698.726497:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 217 00000100:00100000:1.0:1788744698.731938:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744698.732029:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451212800 00000100:00100000:2.0:1788744698.732040:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451212800 00000100:00100000:2.0:1788744698.732102:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 218 00000100:00100000:2.0:1788744698.732112:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+61:11595:x1875634451212800:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744698.732179:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744698.732183:0:11306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788744698.732209:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392da2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551a5 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.732244:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:2.0:1788744698.732249:0:11306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744698.732265:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392e12 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d551c8 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744698.732875:0:11306:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788744698.733078:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392e19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.733094:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.733105:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392e19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.733541:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392e12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551c8 expref: 63 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.733562:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392e19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551c8 expref: 62 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.733569:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:2.0:1788744698.733572:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744698.733574:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2e00, rc 0) 00000100:00100000:2.0:1788744698.733871:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+62:11595:x1875634451212800:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1759us (1941us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788744698.733881:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 218 00000100:00100000:3.0:1788744698.745092:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744698.746332:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451213056 00000100:00100000:0.0:1788744698.746350:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451213056 00000100:00100000:0.0:1788744698.746424:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 219 00000100:00100000:0.0:1788744698.746452:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+62:11595:x1875634451213056:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788744698.746519:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744698.746545:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2e00/0x4b162761eb392e19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551c8 expref: 62 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.746687:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93a209e2e600) 00010000:00010000:0.0:1788744698.746699:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744698.746796:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.746812:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.746824:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.746838:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x14409a94 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.746845:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x14409a94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.746851:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x14409a94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.746915:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.746922:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e27 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.746939:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.746944:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744698.746948:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.746956:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.746965:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:0.0:1788744698.746968:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744698.746972:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e27 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.746977:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.746988:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x14409a94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.746995:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x14409a94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.747001:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x14409a94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.747005:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744698.747008:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x14409a94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.747023:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x14409a94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.747032:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x14409a94 (ffff93a203c30700) 00010000:00010000:0.0:1788744698.747035:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744698.747038:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x14409a94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.747043:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x14409a94 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744698.748669:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+61:11595:x1875634451213056:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 681us (2048us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788744698.748682:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 219 00000100:00100000:0.0:1788744698.753618:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744698.756346:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451213184 00000100:00100000:2.0:1788744698.756365:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451213184 00000100:00100000:2.0:1788744698.756438:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 220 00000100:00100000:2.0:1788744698.756449:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+61:11595:x1875634451213184:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744698.756472:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744698.756497:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392e35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d551cf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.756535:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392e3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.756550:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.756573:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.756679:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3000/0x4b162761eb392e35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551cf expref: 63 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.756698:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392e3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551cf expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.756707:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:2.0:1788744698.756711:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788744698.756714:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3c00, rc 0) 00000100:00100000:2.0:1788744698.757007:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+62:11595:x1875634451213184:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 559us (3401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744698.757014:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 220 00000100:00100000:1.0:1788744698.766240:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744698.766451:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451213440 00000100:00100000:0.0:1788744698.766462:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451213440 00000100:00100000:0.0:1788744698.766526:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 221 00000100:00100000:0.0:1788744698.766537:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+62:11595:x1875634451213440:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788744698.766629:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.766648:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.766662:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788744698.766911:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1788744698.766930:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 401465799907ns, next at 402465796597ns, rc = 0 00000004:00010000:0.0:1788744698.767010:0:5841:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000000b1d5c11 reply state 0000000071d286d5 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744698.767020:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788744698.767118:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+64:11595:x1875634451213440:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 582us (886us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788744698.767126:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 221 00000100:00100000:3.0:1788744698.771259:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744698.771356:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451213568 00000100:00100000:1.0:1788744698.771367:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451213568 00000100:00100000:1.0:1788744698.771429:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 222 00000100:00100000:1.0:1788744698.771439:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+64:11595:x1875634451213568:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744698.771462:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744698.771481:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392e4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d551d6 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.771540:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392e4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551d6 expref: 65 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.771556:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392e4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551d6 expref: 65 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.771574:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:1.0:1788744698.771577:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744698.771580:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051b800, rc 0) 00000100:00100000:1.0:1788744698.771639:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+65:11595:x1875634451213568:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 202us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744698.771647:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 222 00010000:00010000:0.0:1788744698.775862:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.775884:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.775892:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.775899:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744698.775904:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.775911:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.775929:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:0.0:1788744698.775932:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788744698.775937:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.775944:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392e43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744698.776351:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744698.776453:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451213696 00000100:00100000:0.0:1788744698.776463:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451213696 00000100:00100000:0.0:1788744698.776534:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:0.0:1788744698.776544:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2359:x1875634451213696:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788744698.776818:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744698.777017:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+10:2359:x1875634451213696:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 472us (669us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788744698.777025:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:1.0:1788744698.780474:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744698.780572:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451213952 00000100:00100000:2.0:1788744698.780582:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451213952 00000100:00100000:2.0:1788744698.780640:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:2.0:1788744698.780651:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+64:11595:x1875634451213952:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788744698.780904:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+65:11595:x1875634451213952:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 255us (439us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788744698.780913:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:2.0:1788744698.783858:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744698.783932:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451214208 00000100:00100000:0.0:1788744698.783940:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451214208 00000100:00100000:0.0:1788744698.783998:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 223 00000100:00100000:0.0:1788744698.784008:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+65:11595:x1875634451214208:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788744698.784122:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+65:11595:x1875634451214208:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 115us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744698.784171:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 223 00000100:00100000:0.0:1788744698.789360:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744698.799249:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451214336 00000100:00100000:1.0:1788744698.799275:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451214336 00000100:00100000:1.0:1788744698.799341:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 224 00000100:00100000:1.0:1788744698.799351:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+65:11595:x1875634451214336:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744698.799374:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744698.799397:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051be00/0x4b162761eb392e51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d551dd expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.799484:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392e58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.799498:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.799510:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744698.799548:0:11306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744698.799567:0:11306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.799592:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051be00/0x4b162761eb392e51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551dd expref: 67 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.799610:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551dd expref: 66 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.799618:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:1.0:1788744698.799621:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788744698.799625:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051a800, rc 0) 00000100:00100000:1.0:1788744698.799691:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+66:11595:x1875634451214336:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 341us (10341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744698.799698:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 224 00000100:00100000:3.0:1788744698.801652:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744698.801830:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451214464 00000100:00100000:0.0:1788744698.801841:0:12018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451214464 00000100:00100000:0.0:1788744698.801902:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:0.0:1788744698.801917:0:12018:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+10:2360:x1875634451214464:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744698.801934:0:12018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744698.802028:0:12018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392e5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d551e4 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744698.802056:0:12018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e13f9, blocks: 0x1 00010000:00010000:3.0:1788744698.802077:0:12018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1788744698.802082:0:12018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744698.802090:0:12018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392e5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551e4 expref: 11 pid: 12018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.802107:0:12018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392e5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551e4 expref: 11 pid: 12018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.802119:0:12018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80800, rc 0) 00000100:00100000:3.0:1788744698.802212:0:12018:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+11:2360:x1875634451214464:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 301us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744698.810819:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:2.0:1788744698.811056:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744698.811109:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451214720 00000100:00100000:0.0:1788744698.811121:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451214720 00000100:00100000:0.0:1788744698.811437:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 225 00000100:00100000:0.0:1788744698.811449:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+66:11595:x1875634451214720:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788744698.811582:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+66:11595:x1875634451214720:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 135us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744698.811590:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 225 00000100:00100000:0.0:1788744698.813653:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744698.813740:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451214848 00000100:00100000:2.0:1788744698.813750:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451214848 00000100:00100000:2.0:1788744698.813810:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:2.0:1788744698.813821:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+11:11595:x1875634451214848:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744698.813840:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744698.813859:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035d6e866/0x4b162761eb392e66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d551eb expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.813890:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392e5f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551e4 expref: 12 pid: 12018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.813899:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744698.813904:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744698.813909:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035d6e866/0x4b162761eb392e66 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551eb expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.813942:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392e5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551e4 expref: 12 pid: 12018 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.813970:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392e5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551e4 expref: 12 pid: 12018 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744698.813985:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1875634475316096:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744698.814083:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204849cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744698.822761:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1875634475316096:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744698.822817:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000035d6e866/0x4b162761eb392e66 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551eb expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744698.822838:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2e00, rc 0) 00000100:00100000:2.0:1788744698.822906:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+12:11595:x1875634451214848:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 9086us (9262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744698.822915:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:3.0:1788744698.827573:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744698.827738:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451214976 00000100:00100000:0.0:1788744698.827749:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451214976 00010000:00010000:0.0:1788744698.827795:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392e5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551e4 expref: 12 pid: 12018 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744698.827838:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:0.0:1788744698.827848:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+12:2360:x1875634451214976:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744698.827863:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744698.827885:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392e5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551e4 expref: 12 pid: 12018 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.827899:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392e5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551e4 expref: 12 pid: 12018 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.827924:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076b25ec9/0x4b162761eb392e5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551e4 expref: 12 pid: 12018 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.827944:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744698.827949:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744698.827958:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035d6e866/0x4b162761eb392e66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551eb expref: 11 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.827990:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035d6e866/0x4b162761eb392e66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551eb expref: 11 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.828031:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000035d6e866/0x4b162761eb392e66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551eb expref: 11 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744698.828047:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d13ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875634475316224:192.168.201.6@tcp:105: 00000100:00100000:0.0:1788744698.829354:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744698.844490:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744698.844587:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d13ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1875634475316224:192.168.201.6@tcp:105: 00010000:00010000:0.0:1788744698.844616:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744698.844680:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+11:2360:x1875634451214976:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 16832us (17117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744698.844692:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:3.0:1788744698.845957:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451215104 00000100:00100000:3.0:1788744698.845970:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451215104 00002000:00100000:3.0:1788744698.846030:0:6689:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff93a207ef0000 x1875634451215104/t0(0) o4->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:219/0 lens 504/0 e 0 to 0 dl 1788744709 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788744698.846041:0:6689:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a207ef0000 with x1875634451215104 ext(0->12) 00002000:00010000:3.0:1788744698.846047:0:6689:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93a207ef0000 00000100:00100000:3.0:1788744698.846083:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:3.0:1788744698.846096:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+11:2359:x1875634451215104:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788744698.846941:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+13:2359:x1875634451215104:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 Request processed in 830us (2758us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788744698.846951:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00002000:00100000:3.0:1788744698.846961:0:6689:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff93a207ef0000 x1875634451215104/t4294967320(0) o4->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:219/0 lens 504/448 e 0 to 0 dl 1788744709 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788744698.846971:0:6689:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a207ef0000 with x1875634451215104 ext(0->12) 00002000:00010000:3.0:1788744698.846976:0:6689:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93a207ef0000 00000100:00100000:2.0:1788744698.868373:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744698.868482:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451215232 00000100:00100000:0.0:1788744698.868493:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451215232 00000100:00100000:0.0:1788744698.868556:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 226 00000100:00100000:0.0:1788744698.868567:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+66:11595:x1875634451215232:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788744698.931695:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1788744698.931707:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1788744698.931729:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93a1070a4c00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788744698.931745:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93a23d53ba00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93a1070a4a80 00000020:00080000:1.0:1788744698.931747:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93a23d53be00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93a23d166400 00000004:00080000:1.0:1788744698.931775:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788744698.931792:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93a204c066c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788744698.931794:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93a202884800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93a204c06000 00000020:00080000:1.0:1788744698.931796:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93a202884d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93a23bf14800 00000001:00080000:1.0:1788744698.931825:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:1.0:1788744698.931864:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788744698.932073:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788744698.932219:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a107518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475316352:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788744698.932304:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744698.932402:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475316352 00000100:00100000:1.0:1788744698.932410:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475316352 00000100:00100000:1.0:1788744698.932476:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788744698.932485:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875634475316352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788744698.932515:0:9032:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1788744698.932548:0:9032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9e13f8, atime: 0x6a9e13f8, ctime: 0x6a9e13f8, blocks: 0x1 00010000:00010000:1.0:1788744698.932556:0:9032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb392e6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.932573:0:9032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=401s v=(0 0) 00000100:00100000:0.0:1788744698.932626:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+20:11595:x1875634451215232:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 Request processed in 64058us (64260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744698.932636:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 226 00010000:00010000:1.0:1788744698.932652:0:9032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744698.932660:0:9032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb392e6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.932677:0:9032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb392e6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.932696:0:9032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb392e6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.932703:0:9032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb392e6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.932720:0:9032:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788744698.933257:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3307:x1875634475316352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 771us (951us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788744698.933266:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1788744698.933410:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788744698.933425:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744698.933431:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb392e6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.933441:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051ba00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744698.933445:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb392e6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.933454:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb392e6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.933470:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb392e6d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.933490:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb392e6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744698.933512:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744698.933514:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744698.933515:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788744698.933894:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93a107518000/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788744698.933902:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a107518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475316352:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788744698.934315:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475316608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788744698.934359:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744698.934424:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475316608 00000100:00100000:3.0:1788744698.934431:0:12018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475316608 00000100:00100000:3.0:1788744698.934480:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788744698.934489:0:12018:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3309:x1875634475316608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788744698.934733:0:12018:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788744698.934737:0:12018:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788744698 00002000:00010000:3.0:1788744698.934739:0:12018:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788744698.934741:0:12018:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788744697 -> 1788744698 00002000:00010000:3.0:1788744698.934743:0:12018:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788744698.934781:0:12018:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3309:x1875634475316608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 293us (421us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788744698.934854:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788744698.934875:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788744698.934902:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93a23d135180/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788744698.934908:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475316608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788744698.935089:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744698.935105:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475316480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788744698.935176:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744698.935253:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475316480 00000100:00100000:3.0:1788744698.935259:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475316480 00000100:00100000:3.0:1788744698.935294:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788744698.935302:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1875634475316480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788744698.935321:0:6685:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1788744698.935342:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392e74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.935364:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033efbeea/0x4b162761eb392c2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5514a expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.935372:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788744698.935377:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744698.935382:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392e74 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.935527:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033efbeea/0x4b162761eb392c2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5514a expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.935542:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033efbeea/0x4b162761eb392c2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5514a expref: 12 pid: 6682 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744698.935554:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1875634475316736:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788744698.935735:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20489ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744698.937811:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744698.937892:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451215360 00000100:00100000:1.0:1788744698.937902:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451215360 00000100:00100000:1.0:1788744698.937969:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:1.0:1788744698.937980:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+13:2362:x1875634451215360:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788744698.942628:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1875634475316736:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744698.942653:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392e74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744698.942716:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744698.942737:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451215488 00000100:00100000:3.0:1788744698.942744:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451215488 00010000:00010000:3.0:1788744698.942769:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033efbeea/0x4b162761eb392c2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5514a expref: 14 pid: 6682 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744698.942801:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 83 00000100:00100000:3.0:1788744698.942807:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+14:2360:x1875634451215488:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744698.942818:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744698.942822:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033efbeea/0x4b162761eb392c2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5514a expref: 14 pid: 6682 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.942846:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033efbeea/0x4b162761eb392c2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5514a expref: 14 pid: 6682 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.942867:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033efbeea/0x4b162761eb392c2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5514a expref: 14 pid: 6682 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.942884:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744698.942889:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744698.942895:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392e74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.942903:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392e74 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.942921:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744698.942970:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+13:2360:x1875634451215488:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 162us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744698.942977:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 83 00010000:00010000:3.0:1788744698.943004:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392e74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.943012:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392e74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.943022:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392e74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.943036:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392e74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.943052:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788744698.943583:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3307:x1875634475316480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8281us (8406us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788744698.943590:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1788744698.943609:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744698.943614:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392e74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.943620:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81800 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744698.943623:0:8445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392e74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.943630:0:8445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392e74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.943639:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392e74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.943643:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c89ef1c/0x4b162761eb392e74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744698.943656:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744698.943662:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744698.943663:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788744698.943688:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93a23d134a80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788744698.943693:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475316480:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788744698.990554:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1788744698.990772:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:3.0:1788744698.990787:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1788744698.990791:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1788744698.990902:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2362:x1875634451215360:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 Request processed in 52918us (53093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744698.990913:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 68 00010000:00010000:0.0:1788744698.997285:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744698.998385:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744698.999357:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451215744 00000100:00100000:1.0:1788744698.999370:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451215744 00000100:00100000:1.0:1788744698.999507:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 227 00000100:00100000:0.0:1788744698.999540:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+20:11595:x1875634451215744:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788744698.999605:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744698.999632:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392e58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551dd expref: 20 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.999653:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:0.0:1788744698.999659:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744698.999687:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392e7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.999702:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392e7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744698.999712:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392e7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744699.000576:0:5842:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000039df4b79 reply state 000000009dd20593 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392e7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744699.000590:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788744699.000713:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+21:11595:x1875634451215744:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 1194us (2333us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788744699.000722:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 227 00010000:00010000:3.0:1788744699.003563:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392e7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744699.003615:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744699.003723:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451215872 00000100:00100000:2.0:1788744699.003735:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451215872 00010000:00010000:3.0:1788744699.003797:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392e7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744699.003802:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 69 00010000:00010000:3.0:1788744699.003805:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392e7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744699.003811:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2359:x1875634451215872:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00010000:00010000:3.0:1788744699.003812:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744699.003817:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392e7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.003824:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392e7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.003840:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:3.0:1788744699.003843:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744699.003848:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392e7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.003861:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f200/0x4b162761eb392e7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744699.004058:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788744699.004062:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788744698 -> 1788744697 00002000:00010000:2.0:1788744699.004064:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788744696 00002000:00010000:2.0:1788744699.004067:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788744698 -> 1788744697 00002000:00010000:2.0:1788744699.004080:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788744699.004174:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2359:x1875634451215872:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 352us (552us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788744699.004182:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:3.0:1788744699.007867:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744699.007943:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451216128 00000100:00100000:1.0:1788744699.007954:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451216128 00000100:00080000:3.0:1788744699.008066:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744699.008197:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 228 00000100:00100000:1.0:1788744699.008210:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+20:11595:x1875634451216128:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788744699.008284:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.008302:0:11306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392e3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551cf expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.008312:0:11306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e82 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.008366:0:11306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392e3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551cf expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.008400:0:11306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392e3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551cf expref: 20 pid: 5840 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744699.008414:0:11306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a107518e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475316864:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744699.008500:0:11306:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2109be3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744699.010548:0:11306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a107518e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11306:1875634475316864:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744699.010580:0:11306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744699.011240:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744699.011544:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451216256 00000100:00100000:2.0:1788744699.011553:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451216256 00010000:00010000:2.0:1788744699.011594:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392e3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551cf expref: 21 pid: 5840 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744699.011676:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:2.0:1788744699.011688:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d136d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+21:2359:x1875634451216256:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744699.011704:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744699.011711:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392e3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551cf expref: 21 pid: 5840 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744699.011722:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392e3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551cf expref: 21 pid: 5840 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744699.011744:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3c00/0x4b162761eb392e3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551cf expref: 21 pid: 5840 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744699.011763:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:2.0:1788744699.011772:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744699.011796:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744699.011804:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e82 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744699.011839:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744699.011906:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d136d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+20:2359:x1875634451216256:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 220us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744699.011913:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 84 00010000:00010000:1.0:1788744699.012250:0:11306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.012260:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.012288:0:11306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.012294:0:11306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.012301:0:11306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.012307:0:11306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051ba00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744699.012311:0:11306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.012318:0:11306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.012328:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:1.0:1788744699.012331:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788744699.012342:0:11306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.012348:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744699.012391:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+20:11595:x1875634451216128:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 Request processed in 4185us (4535us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788744699.012400:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 228 00000100:00100000:3.0:1788744699.017370:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744699.017596:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451216384 00000100:00100000:0.0:1788744699.017606:0:12018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451216384 00000100:00100000:0.0:1788744699.017667:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:0.0:1788744699.017677:0:12018:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2360:x1875634451216384:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788744699.017723:0:12018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cf6d21f6/0x4b162761eb392e89 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.017742:0:12018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035d6e866/0x4b162761eb392e66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551eb expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.017752:0:12018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744699.017756:0:12018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744699.017761:0:12018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf6d21f6/0x4b162761eb392e89 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.017798:0:12018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035d6e866/0x4b162761eb392e66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551eb expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.017813:0:12018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035d6e866/0x4b162761eb392e66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551eb expref: 8 pid: 6685 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744699.017828:0:12018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d13ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12018:1875634475316992:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788744699.017922:0:12018:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744699.021308:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744699.021392:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451216512 00000100:00100000:1.0:1788744699.021402:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451216512 00010000:00010000:1.0:1788744699.021450:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035d6e866/0x4b162761eb392e66 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551eb expref: 9 pid: 6685 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744699.021489:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:1.0:1788744699.021498:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2360:x1875634451216512:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744699.021516:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744699.021538:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035d6e866/0x4b162761eb392e66 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551eb expref: 9 pid: 6685 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.021552:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035d6e866/0x4b162761eb392e66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551eb expref: 9 pid: 6685 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.021576:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744699.021581:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744699.021586:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf6d21f6/0x4b162761eb392e89 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.021613:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf6d21f6/0x4b162761eb392e89 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.021635:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744699.021694:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+9:2360:x1875634451216512:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 197us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744699.021702:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 85 00010000:00010000:0.0:1788744699.022317:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035d6e866/0x4b162761eb392e66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551eb expref: 8 pid: 6685 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744699.022336:0:12018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d13ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12018:1875634475316992:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788744699.022368:0:12018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cf6d21f6/0x4b162761eb392e89 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.022379:0:12018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cf6d21f6/0x4b162761eb392e89 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.022386:0:12018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf6d21f6/0x4b162761eb392e89 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.022667:0:12018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cf6d21f6/0x4b162761eb392e89 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.022678:0:12018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf6d21f6/0x4b162761eb392e89 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.022687:0:12018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf6d21f6/0x4b162761eb392e89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.022694:0:12018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e400 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744699.022699:0:12018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf6d21f6/0x4b162761eb392e89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.022708:0:12018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf6d21f6/0x4b162761eb392e89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.022725:0:12018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf6d21f6/0x4b162761eb392e89 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.022740:0:12018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf6d21f6/0x4b162761eb392e89 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744699.022808:0:12018:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2360:x1875634451216384:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 Request processed in 5132us (5449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744699.022817:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:3.0:1788744699.024969:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744699.025058:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451216768 00000100:00100000:0.0:1788744699.025069:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451216768 00000100:00100000:0.0:1788744699.025187:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 229 00000100:00100000:0.0:1788744699.025197:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+19:11595:x1875634451216768:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788744699.025296:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.025319:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.025334:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.025549:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392e97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.025562:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392e4a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551d6 expref: 20 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.025570:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392e97 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.025624:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392e4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551d6 expref: 20 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.025638:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392e4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551d6 expref: 20 pid: 11306 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744699.025653:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d13ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875634475317120:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788744699.025745:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744699.035727:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d13ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875634475317120:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788744699.035759:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392e97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744699.035917:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744699.035964:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451216896 00000100:00100000:0.0:1788744699.035971:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451216896 00010000:00010000:0.0:1788744699.036005:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392e4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551d6 expref: 21 pid: 11306 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744699.036043:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:0.0:1788744699.036053:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+21:2360:x1875634451216896:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744699.036069:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744699.036077:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392e4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551d6 expref: 21 pid: 11306 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.036089:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392e4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551d6 expref: 21 pid: 11306 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.036183:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392e4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551d6 expref: 21 pid: 11306 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.036200:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:0.0:1788744699.036204:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392e97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.036213:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392e97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.036221:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392e97 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.036250:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744699.036306:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+20:2360:x1875634451216896:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 254us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744699.036323:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 86 00010000:00010000:1.0:1788744699.036428:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392e97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.036436:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392e97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744699.036629:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1788744699.036789:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788744699.036841:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1788744699.036932:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a107519f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875634475317248:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788744699.036982:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744699.037013:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2049c6780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744699.037104:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475317248 00000100:00100000:3.0:1788744699.037110:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475317248 00000100:00100000:3.0:1788744699.037195:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744699.037204:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a10751ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875634475317248:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788744699.037281:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a10751ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875634475317248:12345-0@lo:1000:mdt00_001.0 Request processed in 79us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744699.037288:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788744699.037756:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1788744699.037762:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1788744699.037779:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93a23d135180, transno 4294967321 00000100:00100000:1.0:1788744699.037798:0:5841:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff93a23d134a80 x1875634475316480/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788744714 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744699.037808:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a107519f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875634475317248:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788744699.038323:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788744699.038397:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a107519f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875634475317376:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788744699.038441:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744699.038472:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23cde20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744699.038711:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475317376 00000100:00100000:0.0:1788744699.038718:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475317376 00000100:00100000:0.0:1788744699.038761:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788744699.038770:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a10751b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875634475317376:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788744699.038962:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a10751b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5841:x1875634475317376:12345-0@lo:1000:mdt00_001.0 Request processed in 193us (519us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788744699.038968:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744699.039308:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a107519f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1875634475317376:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788744699.039363:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392e97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.039376:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392e97 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.039385:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392e97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.039393:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ec00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744699.039430:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392e97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.039438:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392e97 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.039456:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93a209e2e300) 00010000:00010000:3.0:1788744699.039460:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744699.039464:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392e97 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.039469:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ec00/0x4b162761eb392e97 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.039498:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.039501:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dda lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.039505:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.039509:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744699.039510:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.039514:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dda lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.039518:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:3.0:1788744699.039520:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744699.039530:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392de1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551ba expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.039539:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392de1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551ba expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.039546:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392de1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551ba expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.039569:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392de1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551ba expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744699.039745:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d134380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875634475317504:192.168.201.6@tcp:105: 00000100:00100000:3.0:1788744699.039807:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20489e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744699.042998:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d134380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1875634475317504:192.168.201.6@tcp:105: 00010000:00010000:1.0:1788744699.043032:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dda lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043042:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392dda lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043075:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043089:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043101:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043112:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043118:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e9e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043124:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043155:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051ba00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744699.043168:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043195:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e9e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043207:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:1.0:1788744699.043210:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744699.043214:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e9e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043220:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392e9e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043231:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043237:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043243:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043247:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744699.043250:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043255:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043262:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:1.0:1788744699.043264:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788744699.043267:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.043283:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392e90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744699.043489:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+23:11595:x1875634451216768:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 18292us (18527us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1788744699.043501:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 229 00000020:00080000:1.0:1788744699.043507:0:5841:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788744699.043744:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744699.043749:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744699.044276:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788744699.044294:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744699.044819:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744699.045216:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451217024 00000100:00100000:2.0:1788744699.045225:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451217024 00000100:00100000:2.0:1788744699.045278:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:2.0:1788744699.045289:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+23:11594:x1875634451217024:12345-192.168.201.6@tcp:49:lfs.0 00000100:00100000:2.0:1788744699.045429:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+23:11594:x1875634451217024:12345-192.168.201.6@tcp:49:lfs.0 Request processed in 142us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744699.045435:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:3.0:1788744699.047392:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744699.047914:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451217280 00000100:00100000:2.0:1788744699.047925:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451217280 00000100:00100000:2.0:1788744699.048088:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:2.0:1788744699.048100:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a210df6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+23:11595:x1875634451217280:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788744699.048876:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788744699.048998:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788744699.049048:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392ea5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744699.049068:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744699.049090:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744699.049098:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392ea5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744699.049104:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392ea5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744699.049110:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392ea5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744699.049155:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788744699.051887:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a210df6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+25:11595:x1875634451217280:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 3779us (4491us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788744699.051900:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000020:00080000:2.0:1788744699.051907:0:5843:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788744699.052178:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744699.052193:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392ea5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.052290:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2800 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744699.052296:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392ea5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.052306:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392ea5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.052323:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93a209e2e900) 00010000:00010000:3.0:1788744699.052326:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788744699.052346:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392ea5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.052353:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb392ea5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744699.052374:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744699.052376:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744699.052378:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744699.052443:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744699.052503:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451217536 00000100:00100000:0.0:1788744699.052514:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451217536 00000100:00100000:0.0:1788744699.052573:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 230 00000100:00100000:0.0:1788744699.052591:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+25:11594:x1875634451217536:12345-192.168.201.6@tcp:58:lfs.0 00000040:00080000:0.0:1788744699.052869:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788744699.052946:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+25:11594:x1875634451217536:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 365us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744699.052955:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 230 00000100:00100000:0.0:1788744699.093216:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744699.093304:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451217664 00000100:00100000:1.0:1788744699.093316:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451217664 00000100:00100000:1.0:1788744699.093387:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 231 00000100:00100000:1.0:1788744699.093408:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+25:11597:x1875634451217664:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788744699.093434:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744699.093457:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392eac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d551f2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.093526:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392eb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.093539:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.093547:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.093558:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392eba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.093563:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.093593:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.093779:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392ec1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.093787:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392dcc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551b3 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.093793:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392ec1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.093824:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392dcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551b3 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.093835:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392dcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551b3 expref: 26 pid: 5841 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744699.093846:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a10751a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475317632:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788744699.093917:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23cde2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788744699.096750:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a10751a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1875634475317632:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744699.096788:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392ec1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744699.097414:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744699.097678:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451217920 00000100:00100000:1.0:1788744699.097688:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451217920 00000100:00100000:1.0:1788744699.097754:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:1.0:1788744699.097764:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+27:5600:x1875634451217920:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788744699.098004:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+28:5600:x1875634451217920:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 241us (596us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788744699.098012:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:0.0:1788744699.099708:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744699.100018:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451218048 00000100:00100000:1.0:1788744699.100029:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451218048 00010000:00010000:1.0:1788744699.100069:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392dcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551b3 expref: 28 pid: 5841 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744699.100112:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 87 00000100:00100000:1.0:1788744699.100151:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20d762050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+28:2359:x1875634451218048:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744699.100176:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744699.100185:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392dcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551b3 expref: 28 pid: 5841 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.100198:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392dcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551b3 expref: 28 pid: 5841 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.100222:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392dcc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d551b3 expref: 28 pid: 5841 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.100239:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:1.0:1788744699.100245:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392ec1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.100255:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.100264:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392ec1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744699.100372:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744699.100445:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20d762050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+27:2359:x1875634451218048:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 323us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744699.100452:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 87 00010000:00010000:0.0:1788744699.100890:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.100901:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744699.104510:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788744699.104521:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744699.104552:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104571:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104581:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104588:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392eb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104617:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104623:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744699.104628:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104636:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392eb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104651:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:0.0:1788744699.104654:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744699.104659:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392eb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104665:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb392eb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104680:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104686:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392eba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104691:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392eba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104696:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744699.104699:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392eba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104715:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392eba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104724:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93a203446500) 00010000:00010000:0.0:1788744699.104726:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744699.104730:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392eba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104736:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b800/0x4b162761eb392eba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104782:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb392eac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551f2 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104796:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551f2 expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744699.104803:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:0.0:1788744699.104805:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744699.104807:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051a800, rc 0) 00000100:00100000:0.0:1788744699.104887:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+26:11597:x1875634451217664:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 11489us (11680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744699.104896:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 231 00000040:00080000:3.0:1788744699.876896:0:12513:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744699.876905:0:12513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744699.876968:0:12513:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788744699.876974:0:12513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788744700.025666:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744700.084415:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744700.084424:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744700.084478:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788744700.084486:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788744700.084608:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d13c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875634475317760:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788744700.084731:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744700.087087:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d13c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875634475317760:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788744700.088166:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744700.088429:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451218176 00000100:00100000:0.0:1788744700.088438:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451218176 00000100:00100000:0.0:1788744700.088497:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 232 00000100:00100000:0.0:1788744700.088507:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+26:11609:x1875634451218176:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788744700.088541:0:5840:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788744700.088646:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+26:11609:x1875634451218176:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 139us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744700.088653:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 232 00000100:00100000:0.0:1788744700.098096:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744700.098566:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451218432 00000100:00100000:3.0:1788744700.098577:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451218432 00000100:00100000:3.0:1788744700.098639:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 233 00000100:00100000:3.0:1788744700.098649:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+26:11609:x1875634451218432:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744700.098671:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744700.098692:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392ec8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d551f9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744700.098855:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392ecf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744700.098870:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744700.098881:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744700.098905:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788744700.099252:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81800/0x4b162761eb392ec8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551f9 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744700.099272:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392ecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551f9 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744700.099280:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:3.0:1788744700.099283:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744700.099286:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81400, rc 0) 00000100:00100000:3.0:1788744700.099401:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+28:11609:x1875634451218432:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 751us (1324us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788744700.099408:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 233 00000100:00100000:1.0:1788744700.109838:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744700.109968:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451218688 00000100:00100000:0.0:1788744700.109978:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451218688 00000100:00100000:0.0:1788744700.110064:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 234 00000100:00100000:0.0:1788744700.110074:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a10751a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+28:11609:x1875634451218688:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788744700.110181:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392edd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744700.110199:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392edd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744700.110211:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392edd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744700.110377:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392edd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744700.110385:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392edd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744700.110409:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392edd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744700.110415:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744700.110419:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392edd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744700.110426:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392edd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744700.110437:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:0.0:1788744700.110440:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788744700.110444:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392edd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744700.110451:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e400/0x4b162761eb392edd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744700.110583:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a10751a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+29:11609:x1875634451218688:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 510us (752us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788744700.110591:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 234 00000040:00080000:1.0:1788744700.110723:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788744700.110728:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788744700.111242:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788744700.111251:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788744700.112007:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744700.112090:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451218816 00000100:00100000:0.0:1788744700.112099:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451218816 00000100:00100000:0.0:1788744700.112251:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:0.0:1788744700.112261:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+29:2360:x1875634451218816:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744700.112277:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744700.112298:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81400/0x4b162761eb392ecf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551f9 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744700.112333:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:0.0:1788744700.112338:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744700.114899:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+28:2360:x1875634451218816:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 2625us (2881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744700.114916:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:2.0:1788744700.117289:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744700.118089:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451219072 00000100:00100000:3.0:1788744700.118111:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451219072 00000100:00100000:3.0:1788744700.118195:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:3.0:1788744700.118205:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+28:11609:x1875634451219072:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788744700.118628:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+29:11609:x1875634451219072:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 423us (1347us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788744700.118637:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 64 00000001:00080000:3.0:1788744700.361714:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1788744700.361735:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1788744700.725104:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875634475318144:0@lo:400:kworker.0 00000100:00100000:2.0:1788744700.725212:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744700.725284:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788744700.725290:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475318016:0@lo:400:kworker.0 00000100:00100000:2.0:1788744700.725313:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744700.725330:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475318528:0@lo:400:kworker.0 00000100:00100000:2.0:1788744700.725354:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744700.725409:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475318144 00000100:00100000:2.0:1788744700.725417:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475318144 00000100:00100000:2.0:1788744700.725472:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475318016 00000100:00100000:2.0:1788744700.725475:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475318016 00000100:00100000:2.0:1788744700.725496:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788744700.725503:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875634475318144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744700.725556:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875634475318144:12345-0@lo:400:kworker.0 Request processed in 53us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744700.725563:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788744700.725588:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788744700.725595:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475318016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744700.725622:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475318016:12345-0@lo:400:kworker.0 Request processed in 28us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744700.725628:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788744700.725668:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475318016:0@lo:400:kworker.0 00000100:00100000:2.0:1788744700.725678:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875634475318144:0@lo:400:kworker.0 00000100:00100000:0.0:1788744700.725954:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475318272:0@lo:400:kworker.0 00000100:00100000:0.0:1788744700.725988:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744700.726021:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788744700.726026:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475317888:0@lo:400:kworker.0 00000100:00100000:0.0:1788744700.726052:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744700.726074:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634475318400:0@lo:400:kworker.0 00000100:00100000:0.0:1788744700.726093:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744700.726114:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475318400 00000100:00100000:0.0:1788744700.726117:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475318400 00000100:00100000:0.0:1788744700.726210:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788744700.726217:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875634475318400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744700.726254:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875634475318400:12345-0@lo:400:kworker.0 Request processed in 38us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744700.726260:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788744700.726278:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475317888 00000100:00100000:0.0:1788744700.726282:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475317888 00000100:00100000:0.0:1788744700.726305:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788744700.726311:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3309:x1875634475317888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744700.726340:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+19:3309:x1875634475317888:12345-0@lo:400:kworker.0 Request processed in 30us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744700.726355:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788744700.726391:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475317888:0@lo:400:kworker.0 00000100:00100000:0.0:1788744700.726400:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634475318400:0@lo:400:kworker.0 00000100:00100000:3.0:1788744700.727352:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475318528 00000100:00100000:3.0:1788744700.727361:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475318528 00000100:00100000:3.0:1788744700.727406:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475318272 00000100:00100000:3.0:1788744700.727409:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475318272 00000100:00100000:3.0:1788744700.727458:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788744700.727468:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875634475318528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744700.727533:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875634475318528:12345-0@lo:400:kworker.0 Request processed in 68us (2177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744700.727539:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788744700.727553:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788744700.727559:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475318272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744700.727595:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475318272:12345-0@lo:400:kworker.0 Request processed in 35us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744700.727600:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788744700.727617:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744700.727621:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744700.727623:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744700.727648:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788744700.727655:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93a23c079c00, transno 4294967307 00000004:00080000:3.0:1788744700.727669:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1788744700.727691:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93a107518000, transno 4294967310 00000100:00100000:3.0:1788744700.727698:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475318272:0@lo:400:kworker.0 00000100:00100000:3.0:1788744700.727980:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475318528:0@lo:400:kworker.0 00010000:00010000:3.0:1788744701.048390:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744701.251089:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744701.251113:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475318656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744701.251204:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744701.251270:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475318656 00000100:00100000:3.0:1788744701.251278:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475318656 00000100:00100000:3.0:1788744701.251321:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788744701.251329:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875634475318656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744701.251381:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744701.251428:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875634475318656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744701.251436:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788744701.251486:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475318656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744701.362883:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744701.362929:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744701.362954:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744701.362975:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744701.362994:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744701.363020:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451219456 00000100:00100000:0.0:1788744701.363029:0:12018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451219456 00000100:00100000:0.0:1788744701.363081:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451219584 00000100:00100000:0.0:1788744701.363084:0:12018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451219584 00000100:00100000:0.0:1788744701.363109:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 90 00000100:00100000:0.0:1788744701.363145:0:12018:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2362:x1875634451219456:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744701.363220:0:12018:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2362:x1875634451219456:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 103us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744701.363228:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 90 00000100:00100000:0.0:1788744701.363245:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00100000:0.0:1788744701.363252:0:12018:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2362:x1875634451219584:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744701.363279:0:12018:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2362:x1875634451219584:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 28us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744701.363285:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00100000:0.0:1788744701.363303:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451219712 00000100:00100000:0.0:1788744701.363307:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451219712 00000100:00100000:0.0:1788744701.363333:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451219328 00000100:00100000:0.0:1788744701.363350:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451219328 00000100:00100000:0.0:1788744701.363376:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 156 00000100:00100000:0.0:1788744701.363383:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451219712:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744701.363414:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2362:x1875634451219712:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 30us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744701.363420:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 156 00000100:00100000:0.0:1788744701.363432:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 157 00000100:00100000:0.0:1788744701.363438:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d13df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+29:2362:x1875634451219328:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744701.363464:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d13df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+29:2362:x1875634451219328:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 27us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744701.363470:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 157 00000100:00080000:0.0:1788744701.363493:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744701.363498:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744701.363500:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744701.365753:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451219200 00000100:00100000:2.0:1788744701.365768:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451219200 00000100:00100000:2.0:1788744701.365830:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 296 00000100:00100000:2.0:1788744701.365840:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2362:x1875634451219200:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744701.365920:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202fab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2362:x1875634451219200:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 81us (3044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744701.365926:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 296 00000100:00100000:0.0:1788744701.749620:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475318784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744701.749689:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744701.749837:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475318784 00000100:00100000:2.0:1788744701.749846:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475318784 00000100:00100000:2.0:1788744701.749904:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788744701.749923:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475318784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744701.749958:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744701.750009:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475318784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744701.750017:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788744701.750100:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475318784:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788744701.907624:0:12566:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744701.907632:0:12566:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744701.907662:0:12566:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788744701.907666:0:12566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788744702.072628:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744702.166156:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744702.166239:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451219968 00000100:00100000:0.0:1788744702.166252:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451219968 00000100:00100000:0.0:1788744702.166329:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 235 00000100:00100000:0.0:1788744702.166339:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a10751aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+29:11630:x1875634451219968:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788744702.166369:0:11306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744702.166390:0:11306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392ee4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55200 expref: -99 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744702.166487:0:11306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392eeb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744702.166513:0:11306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392eeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744702.166525:0:11306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392eeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744702.166538:0:11306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788744702.166671:0:11306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392ee4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55200 expref: 32 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744702.166688:0:11306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392eeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55200 expref: 31 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744702.166696:0:11306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:0.0:1788744702.166699:0:11306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788744702.166703:0:11306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17ea00, rc 0) 00000100:00100000:0.0:1788744702.166766:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a10751aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+31:11630:x1875634451219968:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 428us (658us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788744702.166773:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 235 00000100:00100000:3.0:1788744702.170260:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744702.170350:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451220096 00000100:00100000:0.0:1788744702.170369:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451220096 00000100:00100000:0.0:1788744702.170425:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 236 00000100:00100000:0.0:1788744702.170434:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+31:11630:x1875634451220096:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:0.0:1788744702.170498:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392ef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744702.170514:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744702.170543:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744702.170573:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744702.170580:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392ef9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744702.170586:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744702.170592:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ee00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744702.170596:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744702.170603:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744702.170614:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:0.0:1788744702.170617:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744702.170621:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392ef9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744702.170626:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ee00/0x4b162761eb392ef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744702.170702:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:390441fa-c0e0-4bda-b106-b1a75da212d8+31:11630:x1875634451220096:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 269us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744702.170709:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 236 00000100:00100000:3.0:1788744702.304329:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744702.304480:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451220224 00000100:00100000:0.0:1788744702.304507:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451220224 00000100:00100000:0.0:1788744702.304578:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00100000:0.0:1788744702.304589:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2361:x1875634451220224:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:0.0:1788744702.304608:0:9032:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744702.304629:0:9032:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb392f00 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55207 expref: -99 pid: 9032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744702.304654:0:9032:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9e13f9, atime: 0x6a9e13f8, ctime: 0x6a9e13f9, blocks: 0xb 00010000:00010000:0.0:1788744702.304675:0:9032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1788744702.304679:0:9032:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744702.304687:0:9032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb392f00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55207 expref: 8 pid: 9032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744702.304704:0:9032:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb392f00 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55207 expref: 8 pid: 9032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744702.304718:0:9032:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17ee00, rc 0) 00000100:00100000:0.0:1788744702.304781:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2361:x1875634451220224:12345-192.168.201.6@tcp:101:cat.0 Request processed in 194us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744702.304789:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00100000:3.0:1788744702.310688:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744702.310800:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451220352 00000100:00100000:1.0:1788744702.310810:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451220352 00002000:00100000:1.0:1788744702.310859:0:6688:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff93a23d136680 x1875634451220352/t0(0) o3->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:223/0 lens 488/0 e 0 to 0 dl 1788744713 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744702.310870:0:6688:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a23d136680 with x1875634451220352 ext(0->4095) 00002000:00010000:1.0:1788744702.310876:0:6688:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93a23d136680 00000100:00100000:1.0:1788744702.310911:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1788744702.310921:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2360:x1875634451220352:12345-192.168.201.6@tcp:3:cat.0 00000100:00100000:1.0:1788744702.311182:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+8:2360:x1875634451220352:12345-192.168.201.6@tcp:3:cat.0 Request processed in 261us (505us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788744702.311191:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00002000:00100000:1.0:1788744702.311198:0:6688:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff93a23d136680 x1875634451220352/t0(0) o3->390441fa-c0e0-4bda-b106-b1a75da212d8@192.168.201.6@tcp:223/0 lens 488/4536 e 0 to 0 dl 1788744713 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744702.311218:0:6688:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff93a23d136680 with x1875634451220352 ext(0->4095) 00002000:00010000:1.0:1788744702.311221:0:6688:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93a23d136680 00010000:00010000:3.0:1788744703.099009:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744704.123274:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788744704.366593:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1788744704.366608:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1788744704.413790:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788744704.413825:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93a2049c6240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788744704.413830:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93a202884300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93a2049c6780 00000020:00080000:1.0:1788744704.413834:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93a202884200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93a204923000 00000020:00080000:1.0:1788744704.413856:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788744704.413921:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788744704.414152:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1788744705.141390:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744705.844837:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475319040:0@lo:400:kworker.0 00000100:00100000:0.0:1788744705.844911:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744705.844967:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475319040 00000100:00100000:0.0:1788744705.844971:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1078e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475319552:0@lo:400:kworker.0 00000100:00100000:1.0:1788744705.844976:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475319040 00000100:00100000:0.0:1788744705.844997:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744705.845023:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744705.845025:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788744705.845028:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1078e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475319168:0@lo:400:kworker.0 00000100:00100000:1.0:1788744705.845034:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475319040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744705.845079:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744705.845095:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475319040:12345-0@lo:400:kworker.0 Request processed in 63us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744705.845102:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788744705.845113:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475319040:0@lo:400:kworker.0 00000100:00100000:1.0:1788744705.845118:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475319168 00000100:00100000:1.0:1788744705.845120:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475319168 00000100:00100000:0.0:1788744705.845160:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475319552 00000100:00100000:0.0:1788744705.845164:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475319552 00000100:00100000:1.0:1788744705.845176:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788744705.845182:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475319168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744705.845196:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788744705.845202:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475319552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744705.845217:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475319168:12345-0@lo:400:kworker.0 Request processed in 36us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744705.845223:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788744705.845229:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475319552:12345-0@lo:400:kworker.0 Request processed in 28us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744705.845235:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788744705.845258:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744705.845263:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744705.845268:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1078e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475319168:0@lo:400:kworker.0 00000100:00100000:0.0:1788744705.845276:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788744705.845282:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93a23d134a80, transno 4294967322 00000004:00080000:0.0:1788744705.845295:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1788744705.845312:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1078e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475319552:0@lo:400:kworker.0 00000100:00100000:3.0:1788744705.845522:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475318912:0@lo:400:kworker.0 00000100:00100000:3.0:1788744705.845556:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744705.845582:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1078e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634475319424:0@lo:400:kworker.0 00000100:00100000:3.0:1788744705.845603:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744705.845619:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744705.845624:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1078e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475319296:0@lo:400:kworker.0 00000100:00100000:3.0:1788744705.845643:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744705.845671:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475318912 00000100:00100000:3.0:1788744705.845674:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475318912 00000100:00100000:3.0:1788744705.845702:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788744705.845709:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3310:x1875634475318912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744705.845748:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475319296 00000100:00100000:1.0:1788744705.845758:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475319296 00000100:00100000:1.0:1788744705.845790:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788744705.845796:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475319296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744705.845950:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475319424 00000100:00100000:0.0:1788744705.845954:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475319424 00000100:00100000:0.0:1788744705.845980:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788744705.845986:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634475319424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744705.851778:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202faa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3310:x1875634475318912:12345-0@lo:400:kworker.0 Request processed in 6056us (6207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744705.851818:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788744705.853325:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475319296:12345-0@lo:400:kworker.0 Request processed in 7519us (7669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744705.853341:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1788744705.853392:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744705.853399:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744705.854384:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1078e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475319296:0@lo:400:kworker.0 00000100:00100000:3.0:1788744705.854403:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475318912:0@lo:400:kworker.0 00000100:00100000:0.0:1788744705.854493:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634475319424:12345-0@lo:400:kworker.0 Request processed in 8505us (8886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744705.854505:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788744705.861486:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1078e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634475319424:0@lo:400:kworker.0 00010000:00010000:0.0:1788744706.169260:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744706.358394:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475319680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744706.358490:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744706.360103:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475319680 00000100:00100000:3.0:1788744706.360120:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475319680 00000100:00100000:3.0:1788744706.360301:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788744706.360312:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475319680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744706.360357:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744706.360459:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475319680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744706.360467:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788744706.360776:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475319680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744706.472713:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744706.472797:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744706.472832:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744706.472862:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744706.472891:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744706.472944:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451220480 00000100:00100000:0.0:1788744706.472953:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451220480 00000100:00100000:0.0:1788744706.473004:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 298 00000100:00100000:0.0:1788744706.473013:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2361:x1875634451220480:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744706.473108:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2361:x1875634451220480:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 96us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744706.473116:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 298 00000100:00100000:2.0:1788744706.473922:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451220864 00000100:00100000:2.0:1788744706.473930:0:12018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451220864 00000100:00100000:2.0:1788744706.473986:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451220736 00000100:00100000:2.0:1788744706.473989:0:12018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451220736 00000100:00100000:2.0:1788744706.474008:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:2.0:1788744706.474015:0:12018:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2361:x1875634451220864:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744706.474069:0:12018:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2361:x1875634451220864:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 55us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744706.474075:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:2.0:1788744706.474095:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00100000:2.0:1788744706.474102:0:12018:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2361:x1875634451220736:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744706.474151:0:12018:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2361:x1875634451220736:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 22us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744706.474158:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00080000:0.0:1788744706.474406:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744706.474411:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744706.476102:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451220608 00000100:00100000:1.0:1788744706.476114:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451220608 00000100:00100000:2.0:1788744706.476321:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451220992 00000100:00100000:2.0:1788744706.476327:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451220992 00000100:00080000:1.0:1788744706.476340:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744706.476379:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 161 00000100:00100000:2.0:1788744706.476477:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2361:x1875634451220992:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744706.476528:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 162 00000100:00100000:1.0:1788744706.476537:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+18:2361:x1875634451220608:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744706.476565:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3d79cafb-2132-4187-a776-0e0ed417e77b+5:2361:x1875634451220992:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 92us (3672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744706.476565:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+18:2361:x1875634451220608:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 29us (3860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744706.476572:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 162 00000100:00100000:2.0:1788744706.487254:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 161 00000100:00100000:0.0:1788744706.868756:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744706.868778:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a107518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475319808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744706.868849:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744706.868960:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475319808 00000100:00100000:1.0:1788744706.868969:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475319808 00000100:00100000:1.0:1788744706.869016:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788744706.869036:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475319808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744706.869073:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744706.869121:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475319808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744706.869166:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788744706.869250:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a107518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475319808:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788744707.188609:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744707.226375:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744707.226577:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451221120 00000100:00100000:1.0:1788744707.226587:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451221120 00000100:00100000:1.0:1788744707.226651:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 237 00000100:00100000:1.0:1788744707.226662:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+18:11283:x1875634451221120:12345-192.168.201.6@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788744707.226757:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+18:11283:x1875634451221120:12345-192.168.201.6@tcp:60:lhsmtool_posix.0 Request processed in 97us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744707.226764:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 237 00000100:00100000:2.0:1788744707.229627:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744707.231561:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451221376 00000100:00100000:3.0:1788744707.231580:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451221376 00000100:00100000:3.0:1788744707.231666:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:3.0:1788744707.231677:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+18:11283:x1875634451221376:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788744707.232090:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+19:11283:x1875634451221376:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 414us (2472us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788744707.232109:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 65 00000040:00080000:3.0:1788744707.316619:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744707.316631:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744707.317001:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788744707.317009:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788744708.212517:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788744709.121647:0:12767:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:31:46 (1788744706) 00010000:00010000:3.0:1788744709.236718:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788744709.500686:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1788744709.500719:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788744709.500901:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788744709.500915:0:5873:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788744710.260334:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744710.964468:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a10751b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475320064:0@lo:400:kworker.0 00000100:00100000:1.0:1788744710.964533:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744710.964618:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475320064 00000100:00100000:1.0:1788744710.964626:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475320064 00000100:00100000:1.0:1788744710.964673:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788744710.964682:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475320064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744710.964997:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744710.965008:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a107518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475319936:0@lo:400:kworker.0 00000100:00100000:3.0:1788744710.965047:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744710.965084:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475319936 00000100:00100000:3.0:1788744710.965088:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475319936 00000100:00100000:3.0:1788744710.965119:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788744710.965125:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3309:x1875634475319936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744710.965188:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3309:x1875634475319936:12345-0@lo:400:kworker.0 Request processed in 63us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744710.965195:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788744710.965241:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a107518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475319936:0@lo:400:kworker.0 00000100:00100000:2.0:1788744710.965457:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475320576:0@lo:400:kworker.0 00000100:00100000:2.0:1788744710.965487:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744710.965506:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744710.965511:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475320192:0@lo:400:kworker.0 00000100:00100000:2.0:1788744710.965533:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744710.965569:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475320192 00000100:00100000:2.0:1788744710.965573:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475320192 00000100:00100000:2.0:1788744710.965605:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788744710.965612:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475320192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744710.965647:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475320192:12345-0@lo:400:kworker.0 Request processed in 35us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744710.965653:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788744710.965675:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475320576 00000100:00100000:2.0:1788744710.965679:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475320576 00000100:00100000:2.0:1788744710.965705:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788744710.965712:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475320576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744710.965756:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475320576:12345-0@lo:400:kworker.0 Request processed in 44us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744710.965762:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788744710.965795:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475320192:0@lo:400:kworker.0 00000100:00100000:2.0:1788744710.965804:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475320576:0@lo:400:kworker.0 00000100:00080000:2.0:1788744710.965846:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744710.965851:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744710.966019:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475320320:0@lo:400:kworker.0 00000100:00100000:3.0:1788744710.966046:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744710.966076:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744710.966083:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634475320448:0@lo:400:kworker.0 00000100:00100000:3.0:1788744710.966113:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744710.966156:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475320448 00000100:00100000:3.0:1788744710.966161:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475320448 00000100:00100000:3.0:1788744710.966190:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788744710.966196:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875634475320448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744710.966229:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875634475320448:12345-0@lo:400:kworker.0 Request processed in 33us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744710.966235:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1788744710.966249:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744710.966265:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634475320448:0@lo:400:kworker.0 00000100:00100000:1.0:1788744710.966621:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475320064:12345-0@lo:400:kworker.0 Request processed in 1939us (2087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744710.966629:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788744710.967054:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a10751b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475320064:0@lo:400:kworker.0 00000100:00100000:2.0:1788744710.967275:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475320320 00000100:00100000:2.0:1788744710.967281:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475320320 00000100:00100000:2.0:1788744710.967331:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788744710.967339:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475320320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744710.967393:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475320320:12345-0@lo:400:kworker.0 Request processed in 55us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744710.967399:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1788744710.967660:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744710.969212:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475320320:0@lo:400:kworker.0 00010000:00010000:3.0:1788744711.284552:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744711.481479:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475320704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744711.481559:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744711.481640:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475320704 00000100:00100000:3.0:1788744711.481650:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475320704 00000100:00100000:3.0:1788744711.481696:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788744711.481706:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475320704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744711.481741:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744711.481787:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475320704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744711.481793:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788744711.481839:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475320704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744711.537593:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744711.537672:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451221504 00000100:00100000:0.0:1788744711.537681:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451221504 00000100:00080000:3.0:1788744711.537770:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744711.537799:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 238 00000100:00100000:0.0:1788744711.537808:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+5:12294:x1875634451221504:12345-192.168.201.6@tcp:101:lsof.0 00010000:00010000:0.0:1788744711.537825:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744711.537846:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392f07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5520e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744711.537894:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392f0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744711.537905:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392f0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744711.537914:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392f0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744711.537969:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788744711.537973:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744711.538007:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392f0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744711.538026:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17e600/0x4b162761eb392f07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5520e expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744711.538040:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392f0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5520e expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744711.538045:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae700) 00010000:00010000:0.0:1788744711.538047:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744711.538050:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17f600, rc 0) 00000100:00100000:0.0:1788744711.538098:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3d79cafb-2132-4187-a776-0e0ed417e77b+6:12294:x1875634451221504:12345-192.168.201.6@tcp:101:lsof.0 Request processed in 292us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744711.538102:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 238 00000100:00100000:0.0:1788744711.591622:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744711.591665:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744711.591703:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744711.591757:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451221760 00000100:00100000:1.0:1788744711.591768:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451221760 00000100:00100000:0.0:1788744711.591807:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00080000:0.0:1788744711.591830:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744711.591834:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 166 00000100:00100000:1.0:1788744711.591845:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+18:2360:x1875634451221760:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744711.591914:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451221888 00000100:00100000:2.0:1788744711.591918:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451221888 00000100:00100000:1.0:1788744711.591967:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+18:2360:x1875634451221760:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 124us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744711.591971:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451222016 00000100:00100000:2.0:1788744711.591974:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451222016 00000100:00100000:1.0:1788744711.591975:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 166 00000100:00100000:2.0:1788744711.591994:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:2.0:1788744711.592001:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2360:x1875634451221888:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744711.592028:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2360:x1875634451221888:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 28us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744711.592034:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:2.0:1788744711.592051:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:2.0:1788744711.592057:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2360:x1875634451222016:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744711.592082:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2360:x1875634451222016:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744711.592088:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:3.0:1788744711.592345:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451221632 00000100:00100000:3.0:1788744711.592350:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451221632 00000100:00100000:3.0:1788744711.592388:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 300 00000100:00100000:3.0:1788744711.592395:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2360:x1875634451221632:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744711.592428:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2360:x1875634451221632:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 34us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744711.592435:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 300 00000100:00080000:0.0:1788744711.592507:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744711.592511:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744711.989413:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744711.989441:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a107518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475320832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744711.989507:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744711.991535:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475320832 00000100:00100000:1.0:1788744711.991550:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475320832 00000100:00100000:1.0:1788744711.991608:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788744711.991618:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475320832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744711.991657:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744711.991749:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475320832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (2239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744711.991756:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788744711.991908:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a107518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475320832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788744712.308734:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744713.215359:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744713.215511:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451222272 00000100:00100000:3.0:1788744713.215522:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451222272 00000100:00100000:3.0:1788744713.215585:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:3.0:1788744713.215595:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+18:12296:x1875634451222272:12345-192.168.201.6@tcp:35:umount.0 00000100:00100000:3.0:1788744713.215951:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+19:12296:x1875634451222272:12345-192.168.201.6@tcp:35:umount.0 Request processed in 357us (601us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788744713.215958:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00080000:0.0:1788744713.216014:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744713.218574:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744713.218657:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451222528 00000100:00100000:3.0:1788744713.218668:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451222528 00000100:00100000:3.0:1788744713.218729:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 67 00000100:00100000:3.0:1788744713.218739:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+19:12296:x1875634451222528:12345-192.168.201.6@tcp:35:umount.0 00000100:00100000:3.0:1788744713.219207:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+20:12296:x1875634451222528:12345-192.168.201.6@tcp:35:umount.0 Request processed in 467us (640us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788744713.219217:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 67 00000100:00100000:1.0:1788744713.222740:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744713.222904:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451222784 00000100:00100000:3.0:1788744713.222924:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451222784 00000100:00100000:3.0:1788744713.222983:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:3.0:1788744713.222993:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a210df5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+20:12296:x1875634451222784:12345-192.168.201.6@tcp:35:umount.0 00000100:00100000:3.0:1788744713.223325:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a210df5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+21:12296:x1875634451222784:12345-192.168.201.6@tcp:35:umount.0 Request processed in 332us (593us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788744713.223352:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:0.0:1788744713.239033:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744713.239909:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451223040 00000100:00100000:3.0:1788744713.239936:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451223040 00000100:00100000:3.0:1788744713.240055:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:3.0:1788744713.240067:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+21:12296:x1875634451223040:12345-192.168.201.6@tcp:35:umount.0 00000100:00100000:3.0:1788744713.241003:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+22:12296:x1875634451223040:12345-192.168.201.6@tcp:35:umount.0 Request processed in 933us (1978us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788744713.241012:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:1.0:1788744713.248565:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744713.248602:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744713.248632:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744713.248665:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744713.248854:0:9032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451223808 00000100:00100000:0.0:1788744713.248866:0:9032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451223808 00000100:00100000:0.0:1788744713.248977:0:9032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 72 00000100:00100000:0.0:1788744713.248990:0:9032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a10751b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+7:2358:x1875634451223808:12345-192.168.201.6@tcp:9:umount.0 00000020:00000080:0.0:1788744713.249024:0:9032:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb3924d4 00000020:00010000:0.0:1788744713.249033:0:9032:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93a23cd4c000: total 0 00000100:00080000:0.0:1788744713.249038:0:9032:0:(import.c:65:import_set_state_nolock()) ffff93a23cd4e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788744713.249081:0:9032:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788744713.249438:0:9032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a10751b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2358:x1875634451223808:12345-192.168.201.6@tcp:9:umount.0 Request processed in 450us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744713.249447:0:9032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 72 00000100:00100000:0.0:1788744713.249474:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451223168 00000100:00100000:0.0:1788744713.249479:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451223168 00000100:00100000:0.0:1788744713.249509:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451223424 00000100:00100000:0.0:1788744713.249512:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451223424 00000100:00100000:0.0:1788744713.249525:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451223296 00000100:00100000:0.0:1788744713.249528:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451223296 00000100:00100000:0.0:1788744713.249542:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:0.0:1788744713.249549:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+15:2361:x1875634451223168:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744713.249559:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744713.249576:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a201473200/0x4b162761eb391f32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54da0 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744713.249593:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744713.249625:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+14:2361:x1875634451223168:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 77us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744713.249631:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:0.0:1788744713.249643:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:0.0:1788744713.249648:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107518e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+13:2359:x1875634451223424:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744713.249655:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744713.249663:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a107e81c00/0x4b162761eb3921a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e6b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744713.249672:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744713.250069:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107518e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+12:2359:x1875634451223424:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 418us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744713.250076:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:0.0:1788744713.250091:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:0.0:1788744713.250098:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107518000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+11:2361:x1875634451223296:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744713.250108:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744713.250186:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a107e81a00/0x4b162761eb391efa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54d68 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744713.250197:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744713.250218:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107518000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2361:x1875634451223296:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 120us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744713.250224:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000020:00010000:0.0:1788744713.250247:0:8445:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93a23cd4c000: total 0 00010000:00010000:0.0:1788744713.250272:0:8445:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93a23cd4c000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788744713.250320:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005677f89/0x4b162761eb392870 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55040 expref: 4 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744713.250369:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb392f00 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55207 expref: 3 pid: 9032 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744713.250384:0:8445:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93a23cd4c000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788744713.250398:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744713.250400:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744713.250401:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788744713.250411:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744713.257076:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744713.257547:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451223936 00000100:00100000:2.0:1788744713.257558:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451223936 00000100:00100000:2.0:1788744713.257647:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:2.0:1788744713.257658:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+5:2358:x1875634451223936:12345-192.168.201.6@tcp:9:umount.0 00000020:00000080:2.0:1788744713.257690:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb39226c 00000100:00080000:2.0:1788744713.257701:0:6682:0:(import.c:65:import_set_state_nolock()) ffff93a205cd2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788744713.257743:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788744713.258018:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:390441fa-c0e0-4bda-b106-b1a75da212d8+2:2358:x1875634451223936:12345-192.168.201.6@tcp:9:umount.0 Request processed in 362us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744713.258025:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00080000:0.0:1788744713.258093:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788744713.258570:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744713.267260:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744713.267448:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451224960 00000100:00100000:2.0:1788744713.267495:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451224960 00000100:00100000:2.0:1788744713.267552:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 239 00000100:00100000:2.0:1788744713.267563:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1078e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+22:2358:x1875634451224960:12345-192.168.201.6@tcp:39:umount.0 00000020:00000080:2.0:1788744713.267598:0:5841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391f08 00000020:00010000:2.0:1788744713.267616:0:5841:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93a107c4b000: total 0 00000100:00080000:2.0:1788744713.267621:0:5841:0:(import.c:65:import_set_state_nolock()) ffff93a23c7b9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788744713.267646:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1788744713.268033:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1078e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:390441fa-c0e0-4bda-b106-b1a75da212d8+21:2358:x1875634451224960:12345-192.168.201.6@tcp:39:umount.0 Request processed in 470us (785us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788744713.268042:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 239 00000020:00010000:3.0:1788744713.268177:0:8446:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93a107c4b000: total 0 00010000:00010000:3.0:1788744713.268218:0:8446:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93a107c4b000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788744713.268249:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:3.0:1788744713.268253:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744713.268261:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb392751 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ff3 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744713.268282:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:3.0:1788744713.268284:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744713.268288:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb392ec1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551f2 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744713.268301:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:3.0:1788744713.268304:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788744713.268308:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f800/0x4b162761eb392242 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e95 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744713.268322:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae700) 00010000:00010000:3.0:1788744713.268341:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744713.268346:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200031800/0x4b162761eb3928c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55055 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744713.268362:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:3.0:1788744713.268364:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788744713.268367:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17ea00/0x4b162761eb392eeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55200 expref: 16 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744713.268380:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93a203446f00) 00010000:00010000:3.0:1788744713.268383:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744713.268386:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2027e7800/0x4b162761eb3921ee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e80 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744713.268404:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744713.268407:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788744713.268410:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2000/0x4b162761eb392bbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5512e expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744713.268423:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93a209e2e400) 00010000:00010000:3.0:1788744713.268426:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744713.268429:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b200/0x4b162761eb392de1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d551ba expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744713.268443:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744713.268445:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788744713.268449:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030000/0x4b162761eb3928e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5505c expref: 12 pid: 11306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744713.268480:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:3.0:1788744713.268483:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744713.268487:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17fa00/0x4b162761eb392831 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5502b expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744713.268499:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93a203c30800) 00010000:00010000:3.0:1788744713.268501:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788744713.268503:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a200030400/0x4b162761eb39285b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55039 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744713.268517:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93a203c30f00) 00010000:00010000:3.0:1788744713.268519:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788744713.268522:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3a00/0x4b162761eb39252f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54f67 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744713.268534:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93a21a9ae600) 00010000:00010000:3.0:1788744713.268536:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744713.268540:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81200/0x4b162761eb3921d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e79 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744713.268555:0:8446:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93a107c4b000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788744713.268567:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744713.268569:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744713.268571:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744713.332929:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744714.356419:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788744714.628272:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 390441fa-c0e0-4bda-b106-b1a75da212d8 00000020:00000080:1.0:1788744714.628282:0:7638:0:(genops.c:885:class_export_put()) final put ffff93a23cd4c000/390441fa-c0e0-4bda-b106-b1a75da212d8 00000020:00000080:0.0:1788744714.628437:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23cd4c000/390441fa-c0e0-4bda-b106-b1a75da212d8 for lustre-OST0001 00000020:00000080:0.0:1788744714.628579:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a23cd4e000 for lustre-OST0001 00000001:00100000:0.0:1788744714.631724:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 390441fa-c0e0-4bda-b106-b1a75da212d8 00000001:00080000:0.0:1788744714.631740:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1788744714.631921:0:5862:0:(genops.c:885:class_export_put()) final put ffff93a107c4b000/390441fa-c0e0-4bda-b106-b1a75da212d8 00000020:00000080:2.0:1788744714.632368:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a107c4b000/390441fa-c0e0-4bda-b106-b1a75da212d8 for lustre-MDT0000 00000020:00000080:2.0:1788744714.632586:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a23c7b9800 for lustre-MDT0000 00000100:00100000:1.0:1788744714.861408:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744714.861459:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744714.861556:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451225088 00000100:00100000:0.0:1788744714.861566:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451225088 00000100:00100000:0.0:1788744714.861629:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451225216 00000100:00100000:0.0:1788744714.861633:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451225216 00000100:00100000:0.0:1788744714.861673:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:0.0:1788744714.861684:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+11:2359:x1875634451225088:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744714.861700:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744714.861721:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a107e80e00/0x4b162761eb391fda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54db5 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744714.861740:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744714.861810:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+10:2359:x1875634451225088:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 128us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744714.861818:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:0.0:1788744714.861836:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:0.0:1788744714.861842:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d115180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+9:2360:x1875634451225216:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744714.861850:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744714.861861:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a23d17f000/0x4b162761eb391fe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54ddf expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744714.861872:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744714.861901:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d115180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+8:2360:x1875634451225216:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 58us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744714.861908:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:1.0:1788744714.864765:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744714.864854:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451225344 00000100:00100000:0.0:1788744714.864865:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451225344 00000100:00100000:0.0:1788744714.864946:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:0.0:1788744714.864957:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20d761c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+8:2360:x1875634451225344:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744714.864976:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744714.864995:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2064f2200/0x4b162761eb3921a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54e64 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744714.865013:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744714.865079:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20d761c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+7:2360:x1875634451225344:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 117us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744714.865087:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:0.0:1788744714.875303:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744714.875504:0:11306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451225600 00000100:00100000:1.0:1788744714.875514:0:11306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451225600 00000100:00100000:1.0:1788744714.875591:0:11306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 240 00000100:00100000:1.0:1788744714.875616:0:11306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d79cafb-2132-4187-a776-0e0ed417e77b+6:2358:x1875634451225600:12345-192.168.201.6@tcp:39:umount.0 00000020:00000080:1.0:1788744714.875656:0:11306:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391fef 00000020:00010000:1.0:1788744714.875665:0:11306:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93a23f86e000: total 0 00000100:00080000:1.0:1788744714.875670:0:11306:0:(import.c:65:import_set_state_nolock()) ffff93a23f86b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744714.875706:0:11306:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:2.0:1788744714.876289:0:5829:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93a23f86e000: total 0 00010000:00010000:2.0:1788744714.876323:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93a23f86e000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788744714.876350:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae700) 00010000:00010000:2.0:1788744714.876353:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744714.876361:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23d17f600/0x4b162761eb392f0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5520e expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744714.876390:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93a23f86e000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788744714.876399:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744714.876400:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744714.876401:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744714.876550:0:11306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3d79cafb-2132-4187-a776-0e0ed417e77b+3:2358:x1875634451225600:12345-192.168.201.6@tcp:39:umount.0 Request processed in 935us (1258us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788744714.876559:0:11306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 240 00000100:00080000:0.0:1788744714.877108:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744714.907687:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744714.907765:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451225856 00000100:00100000:3.0:1788744714.907787:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451225856 00000100:00100000:3.0:1788744714.907834:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 301 00000100:00100000:3.0:1788744714.907844:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+7:2358:x1875634451225856:12345-192.168.201.6@tcp:251:umount.0 00000020:00000080:3.0:1788744714.907896:0:5835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391ee5 00000020:00010000:3.0:1788744714.907905:0:5835:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93a23c09d800: total 0 00000100:00080000:3.0:1788744714.907910:0:5835:0:(import.c:65:import_set_state_nolock()) ffff93a23c099800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788744714.909332:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24e1ca3b-eb53-4d85-8067-5e5e84d1d26d+3:2358:x1875634451225856:12345-192.168.201.6@tcp:251:umount.0 Request processed in 1480us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744714.909345:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 301 00000020:00010000:2.0:1788744714.915564:0:8446:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93a23c09d800: total 0 00010000:00010000:2.0:1788744714.915575:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744714.915636:0:8446:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93a23c09d800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788744714.915674:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a23d17e800/0x4b162761eb391f39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d54da7 expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744714.915693:0:8446:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93a23c09d800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788744714.915704:0:8446:0:(genops.c:885:class_export_put()) final put ffff93a23c09d800/24e1ca3b-eb53-4d85-8067-5e5e84d1d26d 00010000:00010000:2.0:1788744714.915717:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744714.915719:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744714.915721:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788744714.916915:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23c09d800/24e1ca3b-eb53-4d85-8067-5e5e84d1d26d for MGS 00000020:00000080:0.0:1788744714.916983:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a23c099800 for MGS 00010000:00010000:3.0:1788744715.388527:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788744715.626627:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 390441fa-c0e0-4bda-b106-b1a75da212d8 00000020:00000080:1.0:1788744715.626638:0:6709:0:(genops.c:885:class_export_put()) final put ffff93a205cd1000/390441fa-c0e0-4bda-b106-b1a75da212d8 00000020:00000080:0.0:1788744715.627117:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a205cd1000/390441fa-c0e0-4bda-b106-b1a75da212d8 for lustre-OST0000 00000020:00000080:0.0:1788744715.632030:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a205cd2800 for lustre-OST0000 00000100:00100000:2.0:1788744716.084411:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875634475321216:0@lo:400:kworker.0 00000100:00100000:2.0:1788744716.084506:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744716.084574:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788744716.084581:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475321088:0@lo:400:kworker.0 00000100:00100000:2.0:1788744716.084604:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744716.084624:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475321600:0@lo:400:kworker.0 00000100:00100000:2.0:1788744716.084648:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744716.084684:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475321216 00000100:00100000:2.0:1788744716.084690:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475321216 00000100:00100000:2.0:1788744716.084750:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475321088 00000100:00100000:2.0:1788744716.084753:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475321088 00000100:00100000:2.0:1788744716.084778:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788744716.084800:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875634475321216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744716.084843:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875634475321216:12345-0@lo:400:kworker.0 Request processed in 44us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744716.084847:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788744716.084880:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788744716.084887:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a220a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475321088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744716.084918:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a220a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875634475321088:12345-0@lo:400:kworker.0 Request processed in 32us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744716.084924:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788744716.084948:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475321600 00000100:00100000:2.0:1788744716.084951:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475321600 00000100:00100000:3.0:1788744716.084963:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475321344:0@lo:400:kworker.0 00000100:00100000:2.0:1788744716.084979:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788744716.084985:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475321600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744716.084993:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744716.085013:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788744716.085013:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475321600:12345-0@lo:400:kworker.0 Request processed in 29us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744716.085018:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475320960:0@lo:400:kworker.0 00000100:00100000:2.0:1788744716.085019:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788744716.085029:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475321344 00000100:00100000:2.0:1788744716.085032:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475321344 00000100:00100000:3.0:1788744716.085044:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744716.085065:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a220a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634475321472:0@lo:400:kworker.0 00000100:00100000:3.0:1788744716.085086:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744716.085110:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475320960 00000100:00100000:3.0:1788744716.085114:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475320960 00000100:00100000:3.0:1788744716.085165:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788744716.085173:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3309:x1875634475320960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744716.085223:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:754bab6b-7807-4d58-8a45-456ed56af02a+19:3309:x1875634475320960:12345-0@lo:400:kworker.0 Request processed in 38us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744716.085230:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788744716.085277:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475320960:0@lo:400:kworker.0 00000100:00100000:1.0:1788744716.085404:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788744716.085483:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475321472 00000100:00100000:3.0:1788744716.085495:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475321472 00000100:00100000:3.0:1788744716.085531:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788744716.085537:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875634475321472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744716.085573:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875634475321472:12345-0@lo:400:kworker.0 Request processed in 36us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744716.085579:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:3.0:1788744716.085599:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744716.085603:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744716.085606:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744716.085624:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634475321472:0@lo:400:kworker.0 00000100:00100000:3.0:1788744716.085646:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875634475321088:0@lo:400:kworker.0 00000100:00100000:3.0:1788744716.085655:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a220a54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475321600:0@lo:400:kworker.0 00000100:00100000:3.0:1788744716.085663:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875634475321216:0@lo:400:kworker.0 00000100:00100000:1.0:1788744716.085809:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23ccbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475321344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744716.085877:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23ccbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475321344:12345-0@lo:400:kworker.0 Request processed in 465us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744716.085884:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788744716.085950:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475321344:0@lo:400:kworker.0 00010000:00010000:3.0:1788744716.404596:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744716.596831:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475321728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744716.596930:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744716.596974:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475321728 00000100:00100000:3.0:1788744716.596983:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475321728 00000100:00100000:3.0:1788744716.597031:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788744716.597042:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475321728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744716.597083:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744716.597163:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475321728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744716.597171:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788744716.599237:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475321728:0@lo:13:osp-pre-1-0.0 00000020:01000004:2.0:1788744716.696484:0:12969:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788744716.732030:0:12969:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788744716.732084:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391fa9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.732114:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391fa9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.732121:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb391fa9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.732153:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb391fa9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.732172:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788744716.732177:0:12969:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788744716.732198:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788744716.732202:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788744716.732209:0:12969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788744716.732244:0:12969:0:(import.c:65:import_set_state_nolock()) ffff93a23c6ab800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788744716.732370:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875634475321856:0@lo:39:umount.0 00000100:00100000:1.0:1788744716.732456:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744716.732607:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475321856 00000100:00100000:3.0:1788744716.732615:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475321856 00000100:00100000:3.0:1788744716.732671:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788744716.732679:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875634475321856:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788744716.732712:0:5840:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391cf4 00000100:00080000:3.0:1788744716.732721:0:5840:0:(import.c:65:import_set_state_nolock()) ffff93a204fe7800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788744716.732784:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3306:x1875634475321856:12345-0@lo:39:umount.0 Request processed in 105us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744716.732791:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:3.0:1788744716.732800:0:5840:0:(genops.c:885:class_export_put()) final put ffff93a204fe3000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788744716.732926:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744716.732935:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb391fa9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744716.732945:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e000 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:2.0:1788744716.732948:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb391fa9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744716.732957:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b162761eb391fa9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744716.732973:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b162761eb391fa9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744716.732979:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744716.732981:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788744716.732984:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788744716.733010:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391fa9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744716.733016:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744716.733048:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391fa9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744716.733056:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a23d17e000/0x4b162761eb391fa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391fa9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744716.733069:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744716.733072:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744716.733073:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744716.733079:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744716.733086:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744716.733097:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475321984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744716.733153:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744716.733187:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475321984 00000100:00100000:2.0:1788744716.733192:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475321984 00000100:00100000:2.0:1788744716.733237:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788744716.733244:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:754bab6b-7807-4d58-8a45-456ed56af02a+19:3310:x1875634475321984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744716.733255:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744716.733267:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a201473c00/0x4b162761eb391fa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b162761eb391fa2 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744716.733287:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744716.733316:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:754bab6b-7807-4d58-8a45-456ed56af02a+18:3310:x1875634475321984:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744716.733322:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788744716.733364:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475321984:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788744716.733543:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a204fe3000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788744716.733605:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a204fe7800 for lustre-MDT0000 00000100:00080000:1.0:1788744716.733631:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a23c6ab800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788744716.733640:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875634475321856:0@lo:39:umount.0 00000100:00080000:3.0:1788744716.733714:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788744716.733717:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788744716.733728:0:12969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788744716.734922:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391fb7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.734938:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391fb7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.734945:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb391fb7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.734951:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb391fb7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.735074:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744716.735081:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391ea6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.735088:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391ea6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.735095:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb391ea6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.735101:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb391ea6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744716.740466:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744716.740481:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb391fb7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744716.740514:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80600 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1788744716.740518:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb391fb7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744716.740528:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b162761eb391fb7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744716.740535:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b162761eb391fb7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744716.740541:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788744716.740544:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788744716.740584:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391fb7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744716.740589:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788744716.740653:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475322112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744716.740722:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744716.741524:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391fb7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744716.741535:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a107e80600/0x4b162761eb391fb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391fb7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744716.741552:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744716.741556:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb391ea6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744716.741562:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238530a00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1788744716.741565:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb391ea6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744716.741588:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b162761eb391ea6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744716.741594:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b162761eb391ea6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744716.741600:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788744716.741603:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1788744716.741625:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391ea6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744716.741631:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744716.741651:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391ea6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744716.741659:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744716.741661:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744716.741663:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744716.742087:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23cd9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475322240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744716.742154:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788744716.743386:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788744716.743398:0:12969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a238530a00/0x4b162761eb391e9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391ea6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744716.743429:0:12969:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788744716.743476:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744716.745529:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475322112 00000100:00100000:1.0:1788744716.745544:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475322112 00000100:00100000:1.0:1788744716.745604:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475322240 00000100:00100000:1.0:1788744716.745607:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475322240 00000100:00100000:1.0:1788744716.745634:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744716.745644:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754bab6b-7807-4d58-8a45-456ed56af02a+19:3310:x1875634475322112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744716.745660:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744716.745678:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a23d17fe00/0x4b162761eb391fb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b162761eb391fb0 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744716.745712:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744716.745825:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744716.745835:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:754bab6b-7807-4d58-8a45-456ed56af02a+18:3307:x1875634475322240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744716.745845:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744716.745866:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a201472600/0x4b162761eb391ea6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b162761eb391e9f expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.745884:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744716.745926:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d568e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:754bab6b-7807-4d58-8a45-456ed56af02a+17:3307:x1875634475322240:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (3772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744716.745933:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788744716.748239:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39219a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748262:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb39219a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748270:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb39219a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748277:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb39219a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748309:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744716.748318:0:12969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201472a00/0x4b162761eb391c53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391c5a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748325:0:12969:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201472a00/0x4b162761eb391c53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391c5a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748353:0:12969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201472a00/0x4b162761eb391c53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb391c5a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748359:0:12969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff93a201472a00/0x4b162761eb391c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb391c5a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748375:0:12969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788744716.748380:0:12969:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788744716.748387:0:12969:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788744716.748435:0:12969:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788744716.748440:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788744716.748444:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744716.748450:0:12969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1788744716.748457:0:12969:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93a23c0c6000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788744716.748463:0:12969:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff93a105512000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788744716.748469:0:12969:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff93a23f86e000 3d79cafb-2132-4187-a776-0e0ed417e77b 192.168.201.6@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788744716.748475:0:12969:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff93a2074319c0) has exports, disconnecting them 00000020:00080000:3.0:1788744716.748480:0:12969:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93a23c0c6000), last request at 1788744716 00000020:00000080:3.0:1788744716.748488:0:12969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391e67 00000100:00080000:3.0:1788744716.748507:0:12969:0:(import.c:65:import_set_state_nolock()) ffff93a23c0c3800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788744716.748554:0:12969:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93a23c0c6000): rc 0 00000020:00000080:3.0:1788744716.748557:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a23c0c6000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788744716.748565:0:12969:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93a105512000), last request at 1788744716 00000020:00000080:3.0:1788744716.748568:0:12969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391d9c 00000100:00080000:3.0:1788744716.748573:0:12969:0:(import.c:65:import_set_state_nolock()) ffff93a105512800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788744716.748585:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788744716.748592:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb39219a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748607:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81e00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744716.748610:0:8445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb39219a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748618:0:8445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b162761eb39219a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744716.748624:0:8445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b162761eb39219a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744716.748628:0:8445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788744716.748631:0:8445:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788744716.748633:0:8445:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788744716.748665:0:8445:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb39219a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748671:0:8445:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744716.748690:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb39219a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748696:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a107e81e00/0x4b162761eb392193 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb39219a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748709:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744716.748712:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a201472a00/0x4b162761eb391c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb391c5a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748718:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201472a00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744716.748720:0:8445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a201472a00/0x4b162761eb391c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb391c5a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748734:0:8445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a201472a00/0x4b162761eb391c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b162761eb391c5a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744716.748740:0:8445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a201472a00/0x4b162761eb391c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b162761eb391c5a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744716.748745:0:8445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788744716.748747:0:8445:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788744716.748749:0:8445:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788744716.748763:0:8445:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a201472a00/0x4b162761eb391c53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391c5a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748768:0:8445:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744716.748779:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a201472a00/0x4b162761eb391c53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391c5a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748785:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a201472a00/0x4b162761eb391c53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391c5a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.748804:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744716.748805:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744716.748807:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788744716.748817:0:12969:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93a105512000): rc 0 00000020:00000080:3.0:1788744716.748819:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a105512000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788744716.748829:0:12969:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa3c582273ae0 00000100:00080000:3.0:1788744716.748864:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788744716.748868:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1788744716.748882:0:12969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788744716.748946:0:12969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788744716.748959:0:12969:0:(import.c:65:import_set_state_nolock()) ffff93a2065f4800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788744716.748979:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788744716.748981:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1788744716.748990:0:12969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788744716.749063:0:12969:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788744716.749074:0:12969:0:(import.c:65:import_set_state_nolock()) ffff93a23cd4c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788744716.749107:0:12969:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff93a2074319c0) has no exports 00010000:00010000:0.0:1788744716.749453:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744716.749475:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475322496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744716.749545:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788744716.749610:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23c0c6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788744716.749656:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a105512000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788744716.749694:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a23c0c3800 for lustre-MDT0000 00000020:00000080:0.0:1788744716.749698:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a105512800 for lustre-MDT0000 00000100:00100000:3.0:1788744716.749920:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475322496 00000100:00100000:3.0:1788744716.749928:0:7626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475322496 00000100:00100000:3.0:1788744716.749984:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788744716.749994:0:7626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a107518000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:754bab6b-7807-4d58-8a45-456ed56af02a+17:3309:x1875634475322496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744716.750007:0:7626:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744716.750025:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a238530800/0x4b162761eb391c5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b162761eb391c53 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744716.750043:0:7626:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744716.750088:0:7626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a107518000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:754bab6b-7807-4d58-8a45-456ed56af02a+16:3309:x1875634475322496:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744716.750095:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788744716.750260:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475322496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744716.752694:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:754bab6b-7807-4d58-8a45-456ed56af02a+15:3310:x1875634475322112:12345-0@lo:103:ldlm_bl.0 Request processed in 7039us (11960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744716.752711:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744716.752891:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475322368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744716.752961:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744716.753043:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:754bab6b-7807-4d58-8a45-456ed56af02a:3307:1875634475322240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744716.753068:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475322624:0@lo:9:umount.0 00000100:00100000:1.0:1788744716.753096:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744716.753122:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475322752:0@lo:9:umount.0 00000100:00100000:1.0:1788744716.753170:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744716.753199:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475322624 00000100:00100000:1.0:1788744716.753207:0:12018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475322624 00000100:00100000:0.0:1788744716.753334:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475322368 00000100:00100000:0.0:1788744716.753338:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475322368 00000100:00100000:0.0:1788744716.753384:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788744716.753393:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+15:3308:x1875634475322368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744716.753409:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744716.753442:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2027e6c00/0x4b162761eb39219a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b162761eb392193 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744716.753459:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744716.753495:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:754bab6b-7807-4d58-8a45-456ed56af02a+14:3308:x1875634475322368:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744716.753525:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788744716.753726:0:12018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475322752 00000100:00100000:1.0:1788744716.753730:0:12018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475322752 00000100:00100000:1.0:1788744716.753758:0:12018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788744716.753765:0:12018:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1875634475322624:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788744716.753791:0:12018:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391de9 00000100:00080000:1.0:1788744716.753803:0:12018:0:(import.c:65:import_set_state_nolock()) ffff93a105277800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744716.753841:0:12018:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788744716.754220:0:12018:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3306:x1875634475322624:12345-0@lo:9:umount.0 Request processed in 455us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744716.755357:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788744716.755374:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875634475322752:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788744716.755403:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391ed0 00000100:00080000:0.0:1788744716.755426:0:6682:0:(import.c:65:import_set_state_nolock()) ffff93a23cd65800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788744716.755467:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788744716.755778:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3306:x1875634475322752:12345-0@lo:9:umount.0 Request processed in 410us (2606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744716.755786:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788744716.756007:0:12018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1788744716.756034:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744716.756063:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475322368:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788744716.756114:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a2065f4800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788744716.756142:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788744716.756145:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744716.756148:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475322624:0@lo:9:umount.0 00000100:00080000:1.0:1788744716.756159:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a23cd4c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788744716.756169:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788744716.756171:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744716.756173:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475322752:0@lo:9:umount.0 00010000:00010000:1.0:1788744716.756196:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744716.756296:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744716.758267:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23cd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475322112:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744716.758305:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788744716.770430:0:12969:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff93a2074319c0) has no exports 00000020:00000080:3.0:1788744716.846427:0:12969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391cae 00000020:00000080:3.0:1788744716.846445:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a23b4e9800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788744716.846464:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788744716.851436:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744716.851457:0:12969:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788744716.851462:0:12969:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff93a2064c4d40) has no exports 00000020:00000080:1.0:1788744716.851879:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23b4e9800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788744716.851940:0:12969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391ca7 00000020:00000080:2.0:1788744716.851950:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a23f857000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788744716.852014:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744716.852022:0:12969:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788744716.852025:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a23f834800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788744716.852028:0:12969:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23f834800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788744716.852035:0:12969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788744716.852255:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23f857000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788744717.428852:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744718.452645:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744719.476546:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788744719.729245:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3d79cafb-2132-4187-a776-0e0ed417e77b 00000001:00080000:0.0:1788744719.729274:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788744719.729280:0:5862:0:(genops.c:885:class_export_put()) final put ffff93a23f86e000/3d79cafb-2132-4187-a776-0e0ed417e77b 00000020:00000080:0.0:1788744719.729326:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23f86e000/3d79cafb-2132-4187-a776-0e0ed417e77b for lustre-MDT0000 00000020:00000080:0.0:1788744719.729398:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a23f86b800 for lustre-MDT0000 00000001:00100000:1.0:1788744719.751590:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788744719.751602:0:7638:0:(genops.c:885:class_export_put()) final put ffff93a23cd61800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788744719.751673:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23cd61800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788744719.751729:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a23cd65800 for lustre-OST0001 00010000:00010000:2.0:1788744720.500366:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788744720.783835:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788744720.783844:0:6709:0:(genops.c:885:class_export_put()) final put ffff93a105272800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788744720.783912:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a105272800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788744720.783978:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a105277800 for lustre-OST0000 00000100:00100000:0.0:1788744721.204896:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475323008:0@lo:400:kworker.0 00000100:00100000:0.0:1788744721.205022:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744721.205100:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744721.205107:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475323136:0@lo:400:kworker.0 00000100:00100000:0.0:1788744721.205148:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744721.205183:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475323008 00000100:00100000:0.0:1788744721.205190:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475323008 00000100:00100000:0.0:1788744721.205222:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475323136 00000100:00100000:0.0:1788744721.205236:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475323136 00000100:00100000:0.0:1788744721.205257:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788744721.205264:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2064bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875634475323008:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788744721.205271:0:5842:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788744721.205308:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2064bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875634475323008:12345-0@lo:400:kworker.0 Request processed in 44us (287us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788744721.205315:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788744721.205335:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788744721.205338:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875634475323136:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788744721.205343:0:5842:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788744721.205361:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875634475323136:12345-0@lo:400:kworker.0 Request processed in 22us (213us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788744721.205366:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1788744721.205404:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788744721.205408:0:3307:0:(import.c:65:import_set_state_nolock()) ffff93a23f851000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788744721.205412:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788744721.207126:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744721.207173:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23ccbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475322880:0@lo:400:kworker.0 00000100:00100000:3.0:1788744721.207240:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744721.207304:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475322880 00000100:00100000:3.0:1788744721.207326:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475322880 00000100:00100000:3.0:1788744721.207372:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788744721.207380:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a202f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+14:3309:x1875634475322880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744721.207432:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a202f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:754bab6b-7807-4d58-8a45-456ed56af02a+14:3309:x1875634475322880:12345-0@lo:400:kworker.0 Request processed in 53us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744721.207440:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788744721.207487:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475322880:0@lo:400:kworker.0 00000100:00080000:0.0:1788744721.220422:0:3307:0:(import.c:65:import_set_state_nolock()) ffff93a23f851000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744721.220435:0:3307:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 238 00000100:00080000:0.0:1788744721.220450:0:3307:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93a23f851000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788744721.220486:0:3307:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23d439c00 x1875634475323264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744721.220513:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475323136:0@lo:400:kworker.0 00000100:00080000:0.0:1788744721.220543:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788744721.220547:0:3307:0:(import.c:65:import_set_state_nolock()) ffff93a10551a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788744721.220550:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788744721.220567:0:3307:0:(import.c:65:import_set_state_nolock()) ffff93a10551a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744721.220570:0:3307:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 217 00000100:00100000:1.0:1788744721.220669:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875634475323264:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788744721.220727:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744721.220838:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475323264 00000100:00100000:2.0:1788744721.220845:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475323264 00000100:00100000:2.0:1788744721.220894:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788744721.220901:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875634475323264:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788744721.220925:0:5842:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788744721.224377:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875634475323264:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 3465us (3639us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788744721.224393:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1788744721.224585:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a23f851000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788744721.224591:0:3306:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788744721.224595:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875634475323264:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788744721.224737:0:3307:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93a10551a800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788744721.224791:0:3307:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23d439c00 x1875634475323392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744721.224811:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23ccbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475323008:0@lo:400:kworker.0 00000100:00100000:1.0:1788744721.225194:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875634475323392:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788744721.225244:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744721.225463:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475323392 00000100:00100000:0.0:1788744721.225471:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475323392 00000100:00100000:0.0:1788744721.225513:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788744721.225520:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875634475323392:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788744721.225536:0:5840:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788744721.225591:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875634475323392:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 71us (347us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788744721.225597:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1788744721.227078:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a10551a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744721.227087:0:3306:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788744721.227091:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875634475323392:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1788744721.527188:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744722.548453:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788744722.932299:0:12969:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93a229ce50c0 - data ffff93a241e281b0/ffff93a2416d0c00 00000020:01000000:2.0:1788744722.932473:0:12969:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93a20489d060 - data ffff93a22d8c3798/ffff93a23d662800 00000001:00000004:2.0:1788744722.942645:0:12969:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1788744723.089335:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788744723.089345:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1788744723.089372:0:12969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788744723.089374:0:12969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788744723.089928:0:6828:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788744723.089935:0:6828:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788744723.089945:0:6828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788744723.091325:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788744723.091334:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1788744723.091354:0:12969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788744723.091357:0:12969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788744723.092547:0:7922:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788744723.092557:0:7922:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1788744723.092571:0:7922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788744723.164758:0:12969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391c76 00000020:00000080:0.0:1788744723.164774:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a23d650000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788744723.165861:0:12969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391c8b 00000020:00000080:0.0:1788744723.165872:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a23d657800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788744723.165879:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788744723.165884:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744723.165894:0:12969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788744723.165898:0:12969:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff93a207430000) has no exports 00000020:00000080:1.0:1788744723.169757:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23d650000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788744723.169782:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23d657800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1788744723.170382:0:12969:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788744723.170394:0:12969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391ec9 00000020:00000080:0.0:1788744723.170402:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a23c7be800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788744723.170473:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788744723.170480:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744723.170491:0:12969:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788744723.170495:0:12969:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff93a1062599c0) has no exports 00000020:00000080:0.0:1788744723.170503:0:12969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391ec2 00000020:00000080:0.0:1788744723.170507:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a23cd4f000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788744723.170863:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23c7be800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788744723.171156:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23cd4f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788744723.171621:0:12969:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788744723.171626:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788744723.171631:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788744723.171637:0:12969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788744723.171640:0:12969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788744723.171687:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744723.171696:0:12969:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788744723.171703:0:12969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391de2 00000020:00000080:0.0:1788744723.171710:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a105272000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788744723.171715:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788744723.171720:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744723.171723:0:12969:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788744723.171726:0:12969:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff93a23c6999c0) has no exports 00000020:00000080:0.0:1788744723.171731:0:12969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391ddb 00000020:00000080:0.0:1788744723.171734:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a204965000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788744723.172338:0:12969:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788744723.172342:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788744723.172345:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788744723.172350:0:12969:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788744723.172351:0:12969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788744723.172378:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744723.172384:0:12969:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788744723.172410:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744723.172413:0:12969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788744723.172417:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a210e7b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788744723.172420:0:12969:0:(genops.c:844:class_export_destroy()) destroying export ffff93a210e7b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788744723.172437:0:12969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788744723.172600:0:12969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391c92 00000020:00000080:0.0:1788744723.172607:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a23d650800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788744723.172612:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788744723.172615:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744723.172619:0:12969:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788744723.172622:0:12969:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff93a23d66b380) has no exports 00000020:00000080:0.0:1788744723.172643:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744723.172646:0:12969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788744723.172649:0:12969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391c99 00000020:00000080:0.0:1788744723.172652:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a23d656800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788744723.172659:0:12969:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93a203f6f000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788744723.172663:0:12969:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93a203f6f000 3 00000020:01000004:0.0:1788744723.172666:0:12969:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93a203f6f000 from lustre-MDT0000 00000020:00000080:0.0:1788744723.172686:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744723.172689:0:12969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788744723.172691:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a23d652000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788744723.172694:0:12969:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23d652000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788744723.172700:0:12969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788744723.172724:0:12969:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788744723.172728:0:12969:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788744723.172731:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788744723.172733:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744723.172735:0:12969:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788744723.172754:0:12969:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff93a217efc000 754bab6b-7807-4d58-8a45-456ed56af02a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788744723.172759:0:12969:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff93a2064c3380) has exports, disconnecting them 00000020:00080000:0.0:1788744723.172763:0:12969:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff93a217efc000), last request at 1788744494 00000020:00000080:0.0:1788744723.172777:0:12969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391c37 00000020:00010000:0.0:1788744723.172781:0:12969:0:(genops.c:1920:obd_stale_export_put()) Put export ffff93a217efc000: total 4 00000100:00080000:0.0:1788744723.172786:0:12969:0:(import.c:65:import_set_state_nolock()) ffff93a217efb000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788744723.172847:0:12969:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93a217efc000): rc 0 00000020:00080000:0.0:1788744723.172852:0:12969:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff93a2064c3380) has no exports 00000100:00100000:1.0:1788744723.173056:0:5834:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff93a204e99000:5834] 1 exiting: rc = 0 00000020:00000080:1.0:1788744723.173163:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a23cd4c800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788744723.173170:0:8:0:(genops.c:885:class_export_put()) final put ffff93a23cd4e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788744723.173172:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23cd4e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788744723.173176:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744723.173218:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a105272000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788744723.173223:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a204965000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788744723.173228:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a2065f4800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788744723.173232:0:8:0:(genops.c:885:class_export_put()) final put ffff93a2416c2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788744723.173233:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a2416c2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788744723.173239:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744723.173301:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23d650800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788744723.173304:0:8:0:(genops.c:885:class_export_put()) final put ffff93a23d656000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788744723.173306:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23d656000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788744723.173309:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788744723.173494:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23d656800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1788744723.173664:0:5833:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff93a207e5a400:5833] 0 exiting: rc = 1 00000100:00100000:0.0:1788744723.174309:0:5835:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff93a204e99800:5835] 2 exiting: rc = 0 00000100:00100000:1.0:1788744723.174462:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174470:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174477:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174484:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174490:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174496:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174502:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174506:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174512:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174519:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174524:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174542:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174548:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174553:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174558:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174563:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174569:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174575:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174581:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174586:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174592:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174598:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174605:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174611:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174616:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174621:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174626:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174631:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174635:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174640:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174645:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174650:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174655:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174660:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174666:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174672:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174676:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174681:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174685:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174692:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174697:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174703:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174708:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174713:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174718:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174723:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174736:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174753:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174759:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174764:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174769:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174774:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174779:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174784:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174789:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174795:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174802:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174811:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174817:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174824:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174829:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174835:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174840:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.174845:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788744723.175293:0:12969:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788744723.175297:0:12969:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:3.0:1788744723.175956:0:5829:0:(genops.c:1906:obd_stale_export_get()) Get export ffff93a217efc000: total 0 00010000:00010000:3.0:1788744723.176011:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93a217efc000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788744723.176046:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a200031200/0x4b162761eb391d4f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b162761eb391d48 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744723.176068:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a201473600/0x4b162761eb391f8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b162761eb391f86 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744723.176079:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a107e80400/0x4b162761eb391f55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b162761eb391f4e expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744723.176088:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a107e80200/0x4b162761eb391fd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b162761eb391fcc expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744723.176111:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a107e81000/0x4b162761eb391f63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b162761eb391f5c expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744723.176120:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a201472c00/0x4b162761eb391f7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b162761eb391f78 expref: 4 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744723.176307:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a107e81600/0x4b162761eb39217e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b162761eb392177 expref: 3 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744723.176318:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a107e80000/0x4b162761eb39218c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b162761eb392185 expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744723.176328:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93a217efc000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788744723.176342:0:5829:0:(genops.c:885:class_export_put()) final put ffff93a217efc000/754bab6b-7807-4d58-8a45-456ed56af02a 00010000:00010000:3.0:1788744723.176363:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744723.176366:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744723.176367:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788744723.176405:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a217efc000/754bab6b-7807-4d58-8a45-456ed56af02a for MGS 00000020:00000080:0.0:1788744723.176455:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a217efb000 for MGS 00000020:01000000:1.0:1788744723.176729:0:12969:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93a227f3bf00 - data ffff93a241ed91b0/ffff93a106a97400 00000020:01000000:1.0:1788744723.176864:0:12969:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93a203fe6f00 - data ffff93a201f6a798/ffff93a220a08000 00000020:00000080:1.0:1788744723.177637:0:12969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391c1b 00000020:00000080:1.0:1788744723.177645:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a220768800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788744723.177699:0:12969:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93a203f6f000 from MGS, refs=2 00000020:01000004:1.0:1788744723.177703:0:12969:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93a203f6f000 2 00000020:01000004:1.0:1788744723.177706:0:12969:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93a203f6f000 from MGS 00000020:00000080:1.0:1788744723.177726:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744723.177732:0:12969:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788744723.177735:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a22076c000/MGS 00000020:00000080:1.0:1788744723.177737:0:12969:0:(genops.c:844:class_export_destroy()) destroying export ffff93a22076c000/MGS for MGS 00000020:01000000:1.0:1788744723.177753:0:12969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788744723.177802:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788744723.177806:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744723.177821:0:12969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788744723.177827:0:12969:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff93a23c6a8800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788744723.177833:0:12969:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff93a2064c0000) has exports, disconnecting them 00000020:00080000:1.0:1788744723.177837:0:12969:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff93a23c6a8800), last request at 1788744495 00000020:00000080:1.0:1788744723.177841:0:12969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391ce6 00000020:00080000:1.0:1788744723.177851:0:12969:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93a23c6a8800): rc 0 00000020:00000080:1.0:1788744723.177857:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a23c6a8800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788744723.178454:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a220768800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788744723.179721:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23c6a8800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788744723.180320:0:12969:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788744723.180325:0:12969:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788744723.180329:0:12969:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788744723.180335:0:12969:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788744723.180496:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744723.180503:0:12969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788744723.180510:0:12969:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93a203f6f000 1 00000020:00000080:0.0:1788744723.180516:0:12969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391c0d 00000020:00000080:0.0:1788744723.180523:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a22076f000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788744723.180528:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788744723.180532:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744723.180536:0:12969:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788744723.180539:0:12969:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff93a207433380) has no exports 00000020:00000080:3.0:1788744723.182077:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a23c6ab800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788744723.182097:0:38:0:(genops.c:885:class_export_put()) final put ffff93a23f855000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788744723.182101:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23f855000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788744723.182108:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788744723.182193:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a22076f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788744723.201454:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788744723.201473:0:12969:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788744723.201481:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a210afd000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788744723.201487:0:12969:0:(genops.c:844:class_export_destroy()) destroying export ffff93a210afd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788744723.201512:0:12969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788744723.201675:0:12969:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93a203f6b800 00000020:01000000:3.0:1788744723.201699:0:12969:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788744723.201704:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744723.201709:0:12969:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788744723.201713:0:12969:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff93a220a78000) has no exports 00000100:00100000:3.0:1788744723.201803:0:5841:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff93a220a82600:5841] 1 exiting: rc = 0 00000100:00100000:1.0:1788744723.202118:0:11306:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff93a204e47e00:11306] 3 exiting: rc = 0 00000100:00100000:0.0:1788744723.204892:0:5840:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff93a220a82a00:5840] 0 exiting: rc = 1 00000100:00100000:2.0:1788744723.224387:0:5842:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff93a202f75e00:5842] 2 exiting: rc = 0 00000100:00100000:3.0:1788744723.224710:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224719:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224725:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224732:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224749:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224756:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224764:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224770:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224775:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224781:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224786:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224791:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224796:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224803:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224809:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224814:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224820:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224826:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224831:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224837:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224843:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224849:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224855:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224861:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224867:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224873:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224878:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224896:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224901:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224906:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224913:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224930:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224937:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224943:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224949:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224955:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224961:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224966:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224973:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224979:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.224985:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225115:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225123:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225265:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225273:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225279:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225284:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225289:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225294:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225299:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225305:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225310:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225318:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225323:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225329:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225335:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225340:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225345:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225351:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225356:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225360:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225365:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225380:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.225386:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.230781:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93a2078d3000:5843] 0 exiting: rc = 1 00000100:00100000:1.0:1788744723.230882:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93a20d12de00:5844] 1 exiting: rc = 0 00000100:00100000:0.0:1788744723.231678:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231688:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231695:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231704:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231709:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231715:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231720:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231727:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231734:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231756:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231762:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231769:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231776:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231781:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231787:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231805:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231810:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231816:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231821:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231826:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231831:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231837:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231843:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231848:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231855:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231859:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231865:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231870:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231875:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231880:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231885:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231891:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231896:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231901:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231907:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231912:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231929:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231936:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231942:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231947:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231952:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231957:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231962:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231968:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231973:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231978:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.231984:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232112:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232120:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232125:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232350:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232355:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232360:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232364:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232369:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232375:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232381:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232386:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232391:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232396:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232400:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232405:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232410:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.232415:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.233307:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff93a220a83400:5846] 1 exiting: rc = 0 00000100:00100000:2.0:1788744723.233514:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff93a220a82c00:5845] 0 exiting: rc = 1 00000100:00100000:0.0:1788744723.233865:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.233872:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.233878:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.233884:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.233897:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.233904:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.233910:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.233916:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.233933:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.233939:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.233947:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.233953:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.233959:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.233965:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.233970:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.233976:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234112:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234122:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234295:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234303:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234310:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234328:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234334:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234341:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234347:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234353:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234359:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234366:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234389:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234396:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234402:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234409:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234416:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234423:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234429:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234435:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234442:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234449:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234455:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234461:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234482:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234489:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234496:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234502:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234508:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234516:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234522:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234528:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234535:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234541:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234547:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234554:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234573:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234580:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234587:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234593:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234607:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234613:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234619:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234624:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234631:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234642:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234648:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744723.234654:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.250523:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93a220a83200:5847] 0 exiting: rc = 1 00000100:00100000:2.0:1788744723.250702:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93a220a82800:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1788744723.251242:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251253:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251259:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251264:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251271:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251276:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251282:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251287:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251292:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251297:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251302:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251307:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251313:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251317:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251323:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251328:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251335:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251340:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251346:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251351:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251356:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251375:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251380:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251385:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251391:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251396:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251401:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251406:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251410:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251415:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251419:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251423:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251428:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251432:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251438:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251443:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251448:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251452:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251457:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251462:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251467:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251472:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251476:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251481:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251485:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251490:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251495:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251499:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251503:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251508:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251513:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251517:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251522:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251526:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251531:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251535:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251543:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251547:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251552:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251556:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251561:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251566:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251570:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.251575:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252019:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff93a2078d2c00:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1788744723.252308:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff93a20d0c8800:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1788744723.252398:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252404:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252410:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252415:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252420:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252424:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252430:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252434:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252439:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252444:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252449:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252453:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252458:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252463:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252468:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252473:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252478:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252483:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252488:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252493:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252498:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252502:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252508:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252513:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252519:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252524:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252541:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252546:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252551:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252556:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252561:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252566:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252571:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252576:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252582:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252588:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252593:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252598:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252602:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252607:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252612:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252617:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252622:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252627:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252632:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252637:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252642:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252646:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252651:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252656:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252661:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252665:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252670:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252675:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252681:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252685:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252689:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252693:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252699:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252703:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252708:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252721:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252726:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.252731:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.253873:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff93a20d0c7c00:5851] 0 exiting: rc = 1 00000100:00100000:0.0:1788744723.256524:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff93a20d0c9000:5852] 1 exiting: rc = 0 00000100:00100000:1.0:1788744723.256704:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256712:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256717:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256723:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256729:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256735:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256751:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256756:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256763:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256768:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256774:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256779:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256785:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256791:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256796:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256801:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256806:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256811:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256816:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256821:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256827:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256832:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256838:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256843:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256848:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256853:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256858:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256863:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256868:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256873:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256877:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256882:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256899:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256904:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256909:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256914:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256932:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256937:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256943:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256948:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256953:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256958:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256963:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256968:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256972:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256977:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256982:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.256987:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.257112:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.257116:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.257121:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.257250:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.257260:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.257265:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.257271:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.257277:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.257283:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.257287:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.257293:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.257298:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.257302:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.257306:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.257311:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.257316:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744723.257973:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff93a20d0c0800:5854] 1 exiting: rc = 0 00000100:00100000:0.0:1788744723.258714:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff93a20d0cd400:5853] 0 exiting: rc = 1 00000100:00100000:0.0:1788744723.259062:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff93a23b4b0200:5855] 2 exiting: rc = 0 00000100:00100000:1.0:1788744723.259751:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259760:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259765:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259782:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259788:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259795:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259801:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259806:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259812:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259818:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259824:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259830:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259851:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259858:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259864:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259870:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259876:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259882:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259887:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259893:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259898:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259903:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259909:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259914:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259930:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259936:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259942:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259947:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259953:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259959:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259964:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259969:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259974:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259980:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.259985:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260108:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260286:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260294:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260306:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260311:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260317:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260321:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260326:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260332:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260340:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260345:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260350:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260356:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260362:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260367:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260374:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260379:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260388:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260393:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260399:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260405:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260411:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260417:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260422:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260427:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260433:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260437:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260443:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744723.260448:0:12969:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788744723.268492:0:12969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744723.268507:0:12969:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788744723.268513:0:12969:0:(genops.c:885:class_export_put()) final put ffff93a203d9b000/MDS_uuid 00000020:00000080:0.0:1788744723.268517:0:12969:0:(genops.c:844:class_export_destroy()) destroying export ffff93a203d9b000/MDS_uuid for MDS 00000020:01000000:0.0:1788744723.268524:0:12969:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788744723.268654:0:12969:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788744723.572988:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744724.608324:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744725.621723:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788744726.103047:0:13125:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1788744726.119222:0:13125:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788744726.119262:0:13125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744726.119273:0:13125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391f7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744726.119278:0:13125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb391f7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744726.119283:0:13125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb391f7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744726.119304:0:13125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788744726.119310:0:13125:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788744726.119333:0:13125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788744726.119338:0:13125:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788744726.119344:0:13125:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788744726.119350:0:13125:0:(import.c:65:import_set_state_nolock()) ffff93a10551a800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788744726.119354:0:13125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788744726.119356:0:13125:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788744726.119360:0:13125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788744726.120107:0:13125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f8d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744726.120421:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744726.120428:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb391f7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744726.120495:0:13125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391f8d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744726.120627:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f400 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1788744726.120632:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb391f7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744726.120642:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b162761eb391f7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744726.120648:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b162761eb391f7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744726.120654:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788744726.120663:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788744726.120666:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788744726.120714:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391f7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744726.120721:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744726.120757:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391f7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744726.120764:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb391f78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391f7f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744726.120778:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744726.120780:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744726.120782:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744726.121210:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475323520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744726.121286:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744726.121356:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475323520 00000100:00100000:1.0:1788744726.121364:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475323520 00000100:00100000:1.0:1788744726.121406:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788744726.121414:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d354700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3309:x1875634475323520:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788744726.121433:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788744726 with bad export cookie 5410555303843929143 00010000:00010000:3.0:1788744726.127043:0:13125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb391f8d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744726.127066:0:13125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb391f8d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744726.127234:0:13125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744726.127247:0:13125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39218c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744726.127256:0:13125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb39218c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744726.127263:0:13125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb39218c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744726.127270:0:13125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb39218c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744726.130082:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744726.130100:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb391f8d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744726.130337:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a201473400 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:2.0:1788744726.130341:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb391f8d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744726.130353:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b162761eb391f8d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744726.130360:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b162761eb391f8d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744726.130389:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744726.130392:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1788744726.130435:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391f8d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744726.130442:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788744726.130499:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475323648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744726.130575:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744726.130648:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391f8d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744726.130657:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a201473400/0x4b162761eb391f86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb391f8d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744726.130672:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744726.130676:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb39218c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744726.130682:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e6400 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:2.0:1788744726.130685:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb39218c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744726.130705:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b162761eb39218c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744726.130711:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b162761eb39218c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744726.130717:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788744726.130719:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788744726.130735:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb39218c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744726.130747:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744726.130767:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb39218c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744726.130775:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744726.130777:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744726.130779:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744726.130788:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744726.130802:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475323776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744726.130830:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744726.133082:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475323648 00000100:00100000:0.0:1788744726.133098:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475323648 00000100:00100000:0.0:1788744726.133235:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475323776 00000100:00100000:0.0:1788744726.133240:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475323776 00000100:00100000:0.0:1788744726.133257:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744726.133266:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a20d760c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3310:x1875634475323648:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788744726.133274:0:5825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788744726 with bad export cookie 5410555303843929143 00000100:00100000:0.0:1788744726.133352:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a20d760c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3310:x1875634475323648:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (2775us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788744726.133358:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744726.133377:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788744726.133382:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1875634475323776:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788744726.133386:0:5825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788744726 with bad export cookie 5410555303843929143 00000100:00100000:0.0:1788744726.133434:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1875634475323776:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (2603us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788744726.133441:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788744726.133481:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.106@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788744726.133486:0:3308:0:(import.c:65:import_set_state_nolock()) ffff93a217efd800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788744726.133489:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788744726.133506:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.106@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788744726.133508:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788744726.133514:0:3308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93a23d438000 x1875634475323520/t0(0) o103->MGC192.168.201.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788744742 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744726.133525:0:3308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93a23c9b0000 x1875634475323648/t0(0) o103->MGC192.168.201.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788744742 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744726.133533:0:3308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93a23c9b1f80 x1875634475323776/t0(0) o103->MGC192.168.201.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788744742 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788744726.133541:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788744726.133543:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788744726.133545:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788744726.133548:0:3308:0:(import.c:65:import_set_state_nolock()) ffff93a217efd800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744726.133552:0:3308:0:(import.c:545:import_select_connection()) MGC192.168.201.106@tcp: connect to NID 0@lo last attempt 196 00000100:00080000:0.0:1788744726.133562:0:3308:0:(import.c:666:import_select_connection()) MGC192.168.201.106@tcp: import ffff93a217efd800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788744726.133584:0:3308:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23d439180 x1875634475323904/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744726.133610:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:754bab6b-7807-4d58-8a45-456ed56af02a:3308:1875634475323776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744726.133633:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:754bab6b-7807-4d58-8a45-456ed56af02a:3306:1875634475323904:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1788744726.133658:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875634475323904 offset 0 length 520: 4 00000100:00100000:0.0:1788744726.133685:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:754bab6b-7807-4d58-8a45-456ed56af02a:3310:1875634475323648:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744726.133880:0:13125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788744726.133889:0:13125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a2027e6400/0x4b162761eb392185 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b162761eb39218c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744726.133905:0:13125:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788744726.133910:0:13125:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788744726.133912:0:13125:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788744726.133955:0:13125:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788744726.133959:0:13125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788744726.133964:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744726.133970:0:13125:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788744726.133975:0:13125:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff93a220a799c0) has no exports 00000020:00080000:3.0:1788744726.134000:0:13125:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff93a220a799c0) has no exports 00000020:01000000:3.0:1788744726.135753:0:13125:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93a227f3b060 - data ffff93a241ed9510/ffff93a106a96800 00000020:01000000:3.0:1788744726.135924:0:13125:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93a203f08180 - data ffff93a22db7c0d8/ffff93a105624800 00010000:00010000:0.0:1788744726.136345:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744726.142408:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:754bab6b-7807-4d58-8a45-456ed56af02a:3309:1875634475323520:0@lo:103:ldlm_bl.0 00000400:00000100:0.0:1788744726.159810:0:5827:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875634475323520 offset 224 length 224: 4 00000100:00100000:0.0:1788744726.159839:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d354700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3309:x1875634475323520:12345-0@lo:103:ldlm_bl.0 Request processed in 38424us (38552us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788744726.159850:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00100000:10000000:3.0:1788744726.177447:0:13125:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788744726.212569:0:13125:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391d6b 00000020:00000080:1.0:1788744726.212581:0:13125:0:(genops.c:885:class_export_put()) final put ffff93a104b52800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788744726.212652:0:13125:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93a210e7e800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788744726.212656:0:13125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93a210e7e800 2 00000020:01000004:1.0:1788744726.212659:0:13125:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93a210e7e800 from lustre-OST0000 00000020:00000080:1.0:1788744726.212685:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744726.212707:0:13125:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788744726.212711:0:13125:0:(genops.c:885:class_export_put()) final put ffff93a104b53000/lustre-OST0000_UUID 00000020:00000080:1.0:1788744726.212713:0:13125:0:(genops.c:844:class_export_destroy()) destroying export ffff93a104b53000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788744726.212720:0:13125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788744726.212766:0:13125:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788744726.212771:0:13125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788744726.212775:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744726.212780:0:13125:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788744726.212786:0:13125:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff93a10551a000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788744726.212792:0:13125:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff93a220a7b380) has exports, disconnecting them 00000020:00080000:1.0:1788744726.212797:0:13125:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff93a10551a000), last request at 1788744514 00000020:00000080:1.0:1788744726.212801:0:13125:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391d95 00000020:00080000:1.0:1788744726.212811:0:13125:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93a10551a000): rc 0 00000020:00000080:1.0:1788744726.212816:0:13125:0:(genops.c:885:class_export_put()) final put ffff93a10551a000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788744726.213155:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a104b52800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788744726.213559:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a10551a000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788744726.215084:0:13125:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788744726.215093:0:13125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788744726.215098:0:13125:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788744726.215106:0:13125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788744726.215422:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744726.215431:0:13125:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788744726.215438:0:13125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93a210e7e800 1 00000020:00000080:2.0:1788744726.215446:0:13125:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391d25 00000020:00000080:2.0:1788744726.215454:0:13125:0:(genops.c:885:class_export_put()) final put ffff93a2065f1800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788744726.215558:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a10551a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788744726.215565:0:38:0:(genops.c:885:class_export_put()) final put ffff93a105519800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788744726.215568:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a105519800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788744726.215578:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788744726.215831:0:13125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788744726.215838:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744726.215843:0:13125:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788744726.215847:0:13125:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff93a23d66cd40) has no exports 00000020:00000080:3.0:1788744726.215924:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93a2065f1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788744726.240853:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744726.240868:0:13125:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788744726.240873:0:13125:0:(genops.c:885:class_export_put()) final put ffff93a210e79800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788744726.240878:0:13125:0:(genops.c:844:class_export_destroy()) destroying export ffff93a210e79800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788744726.240898:0:13125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788744726.241033:0:13125:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93a210e7b800 00000020:02000400:2.0:1788744726.241078:0:13125:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:1.0:1788744726.325856:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 754bab6b-7807-4d58-8a45-456ed56af02a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788744726.325864:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 754bab6b-7807-4d58-8a45-456ed56af02a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744726.325867:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788744726.325871:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788744726.325875:0:8:0:(import.c:65:import_set_state_nolock()) ffff93a23f851000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744726.325883:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 423 00000100:00080000:1.0:1788744726.325899:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788744726.325913:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93a23f851000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1788744726.325949:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23d356d80 x1875634475324032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744726.326108:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875634475324032:0@lo:38:kworker.0 00000400:00000100:0.0:1788744726.326202:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634475324032 offset 0 length 520: 4 00010000:00010000:3.0:1788744726.644453:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744727.668256:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744728.700339:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788744728.808814:0:13275:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788744728.823279:0:13275:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788744728.823361:0:13275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744728.823378:0:13275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391f55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744728.823385:0:13275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb391f55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744728.823392:0:13275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb391f55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744728.823427:0:13275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788744728.823434:0:13275:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788744728.823461:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1788744728.823462:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744728.823471:0:8445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb391f55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744728.823480:0:8445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e200 already unused, calling callback (ffffffffc1c2dc20) 00000100:00100000:2.0:1788744728.823485:0:13275:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93a23d356d80 x1875634475324032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788744741 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:0.0:1788744728.823486:0:8445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb391f55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744728.823504:0:8445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b162761eb391f55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744728.823513:0:8445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b162761eb391f55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744728.823519:0:8445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788744728.823522:0:8445:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:2.0:1788744728.823523:0:13275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 10000000:01000000:0.0:1788744728.823524:0:8445:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:2.0:1788744728.823530:0:13275:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788744728.823537:0:13275:0:(import.c:65:import_set_state_nolock()) ffff93a23f851000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1788744728.823541:0:8445:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93a217efd800 00000100:00080000:2.0:1788744728.823543:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1788744728.823547:0:8445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b162761eb391f55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744728.823551:0:13275:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93a23d356d80 x1875634475324032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788744741 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788744728.823562:0:8445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb391f4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b162761eb391f55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744728.823597:0:13275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788744728.823602:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:0.0:1788744728.823602:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744728.823605:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744728.823609:0:8445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744728.823740:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875634475324032:0@lo:38:kworker.0 00010000:00010000:2.0:1788744728.824709:0:13275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb391f63 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744728.824722:0:13275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb391f63 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744728.824729:0:13275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb391f63 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744728.824735:0:13275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb391f63 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744728.824753:0:13275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744728.824759:0:13275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39217e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744728.824766:0:13275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb39217e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744728.824773:0:13275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb39217e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744728.824779:0:13275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b162761eb39217e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744728.824790:0:13275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788744728.824794:0:13275:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788744728.824820:0:13275:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788744728.824824:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788744728.824828:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744728.824833:0:13275:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788744728.824837:0:13275:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff93a2064c19c0) has no exports 00000020:00080000:2.0:1788744728.824859:0:13275:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff93a2064c19c0) has no exports 00010000:00010000:0.0:1788744728.825159:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744728.825168:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb391f63 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744728.825176:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80a00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1788744728.825180:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb391f63 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744728.825189:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b162761eb391f63 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744728.825196:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b162761eb391f63 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744728.825202:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788744728.825205:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788744728.825207:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788744728.825220:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93a217efd800 00010000:00010000:0.0:1788744728.825224:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b162761eb391f63 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744728.825230:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb391f5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b162761eb391f63 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744728.825254:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744728.825258:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb39217e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744728.825273:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17fc00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1788744728.825276:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b162761eb39217e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744728.825283:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b162761eb39217e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744728.825865:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b162761eb39217e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744728.825872:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788744728.825874:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788744728.825876:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788744728.825885:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93a217efd800 00010000:00010000:0.0:1788744728.825889:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b162761eb39217e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744728.825989:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a23d17fc00/0x4b162761eb392177 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b162761eb39217e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744728.826248:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788744728.828989:0:13275:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93a229ce5720 - data ffff93a241e0f438/ffff93a1060c3000 00010000:00010000:1.0:1788744728.829170:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744728.829176:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744728.829180:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788744728.829236:0:13275:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93a2113ea540 - data ffff93a22d972438/ffff93a23c44a400 00100000:10000000:2.0:1788744728.846911:0:13275:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788744728.889949:0:13275:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391e36 00000020:00000080:2.0:1788744728.889961:0:13275:0:(genops.c:885:class_export_put()) final put ffff93a23c0c6800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788744728.890011:0:13275:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93a104b55800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788744728.890019:0:13275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93a104b55800 2 00000020:01000004:2.0:1788744728.890023:0:13275:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93a104b55800 from lustre-OST0001 00000020:00000080:2.0:1788744728.890073:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744728.890082:0:13275:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788744728.890086:0:13275:0:(genops.c:885:class_export_put()) final put ffff93a23f835800/lustre-OST0001_UUID 00000020:00000080:2.0:1788744728.890089:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23f835800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788744728.890095:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788744728.890292:0:13275:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 754bab6b-7807-4d58-8a45-456ed56af02a->MGS 00010000:00010000:2.0:1788744728.890308:0:13275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391d48 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b162761eb391d4f expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744728.890320:0:13275:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391d48 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b162761eb391d4f expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744728.890327:0:13275:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788744728.890330:0:13275:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788744728.890333:0:13275:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788744728.890344:0:13275:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93a217efd800 00010000:00010000:2.0:1788744728.890348:0:13275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a201472400/0x4b162761eb391d48 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b162761eb391d4f expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744728.890375:0:13275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b162761eb391fd3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744728.890382:0:13275:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b162761eb391fd3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744728.890387:0:13275:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744728.890389:0:13275:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788744728.890391:0:13275:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788744728.890399:0:13275:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93a217efd800 00010000:00010000:2.0:1788744728.890402:0:13275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a2027e7a00/0x4b162761eb391fcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b162761eb391fd3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788744728.890416:0:13275:0:(import.c:65:import_set_state_nolock()) ffff93a217efd800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788744728.890419:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788744728.890422:0:13275:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788744728.890423:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788744728.890427:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788744728.890438:0:13275:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93a23d439180 x1875634475323904/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788744736 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788744728.890458:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788744728.890461:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:3.0:1788744728.890517:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:754bab6b-7807-4d58-8a45-456ed56af02a:3306:1875634475323904:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:2.0:1788744728.890569:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788744728.890575:0:13275:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391c29 00000020:00000080:2.0:1788744728.890579:0:13275:0:(genops.c:885:class_export_put()) final put ffff93a203d99800/754bab6b-7807-4d58-8a45-456ed56af02a 00000020:00000080:0.0:1788744728.890630:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23c0c6800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788744728.890699:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.106@tcp (flags='') 00000020:00000080:2.0:1788744728.890704:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744728.890709:0:13275:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.106@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788744728.890713:0:13275:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff93a207434d40) has no exports 10000000:01000000:3.0:1788744728.890841:0:5837:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788744728.891023:0:13275:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.106@tcp: client import never connected 00000100:00080000:2.0:1788744728.891034:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788744728.891037:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788744728.891039:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788744728.891041:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788744728.891073:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a203d99800/754bab6b-7807-4d58-8a45-456ed56af02a for MGC192.168.201.106@tcp 00000020:00000080:2.0:1788744728.891241:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744728.891246:0:13275:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.106@tcp (uuid 754bab6b-7807-4d58-8a45-456ed56af02a) 00000020:01000000:2.0:1788744728.891252:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788744728.891255:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744728.891259:0:13275:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788744728.891263:0:13275:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93a23c0c5800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788744728.891267:0:13275:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff93a23d6699c0) has exports, disconnecting them 00000020:00080000:2.0:1788744728.891272:0:13275:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93a23c0c5800), last request at 1788744535 00000020:00000080:2.0:1788744728.891276:0:13275:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391e60 00000020:00080000:2.0:1788744728.891288:0:13275:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff93a23c0c5800): rc 0 00000020:00000080:2.0:1788744728.891292:0:13275:0:(genops.c:885:class_export_put()) final put ffff93a23c0c5800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788744728.891365:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a217efd800 for MGC192.168.201.106@tcp 00000020:00000080:0.0:1788744728.891371:0:8:0:(genops.c:885:class_export_put()) final put ffff93a217efb800/754bab6b-7807-4d58-8a45-456ed56af02a 00000020:00000080:0.0:1788744728.891373:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a217efb800/754bab6b-7807-4d58-8a45-456ed56af02a for MGC192.168.201.106@tcp 00000020:01000000:0.0:1788744728.891377:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.106@tcp (754bab6b-7807-4d58-8a45-456ed56af02a) 00000020:00000080:0.0:1788744728.892265:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23c0c5800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788744728.922313:0:13275:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788744728.922322:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788744728.922326:0:13275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788744728.922334:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788744728.924449:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:0.0:1788744728.928226:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff93a23f851000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788744728.945301:0:8445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788744728.945497:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1788744728.945872:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1788744728.946011:0:5824:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93a229c31c00:5824] 1 exiting: rc = 0 00000100:00100000:2.0:1788744728.946348:0:5823:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff93a204eabe00:5823] 0 exiting: rc = 1 00000100:00100000:0.0:1788744728.946443:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.946719:0:7626:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff93a23c08c000:7626] 3 exiting: rc = 0 00000100:00100000:0.0:1788744728.946783:0:5826:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93a204eab600:5826] 1 exiting: rc = 0 00000100:00100000:0.0:1788744728.946838:0:5827:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff93a229c30800:5827] 2 exiting: rc = 0 00000100:00100000:3.0:1788744728.948556:0:5825:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff93a204eaa400:5825] 0 exiting: rc = 1 00000100:00100000:0.0:1788744728.949362:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949371:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949376:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949382:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949389:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949395:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949401:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949407:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949411:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949416:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949422:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949427:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949432:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949437:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949443:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949449:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949455:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949461:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949466:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949471:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949476:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949481:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949486:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949491:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949496:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949501:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949506:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949511:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949515:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949538:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949542:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949547:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949553:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949557:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949563:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949568:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949573:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949579:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949583:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949591:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949595:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949599:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949604:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949609:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949615:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949620:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949624:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949629:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949634:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949649:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949656:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949661:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949667:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949671:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949676:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949682:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949688:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949693:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949697:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949702:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949708:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949715:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949720:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.949725:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788744728.951778:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744728.951791:0:13275:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788744728.951797:0:13275:0:(genops.c:885:class_export_put()) final put ffff93a23c09b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788744728.951802:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff93a23c09b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788744728.951808:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788744728.951865:0:13275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93a104b55800 1 00000020:00000080:0.0:1788744728.951872:0:13275:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4b162761eb391e05 00000020:00000080:0.0:1788744728.951879:0:13275:0:(genops.c:885:class_export_put()) final put ffff93a104b54800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788744728.951908:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788744728.951912:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744728.951917:0:13275:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788744728.951921:0:13275:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff93a23d668000) has no exports 00000020:00000080:3.0:1788744728.951975:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93a104b54800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788744728.969203:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744728.969219:0:13275:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788744728.969225:0:13275:0:(genops.c:885:class_export_put()) final put ffff93a104b54000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788744728.969229:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff93a104b54000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788744728.969240:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788744728.969413:0:13275:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93a104b51800 00000020:01000000:0.0:1788744728.969434:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788744728.969439:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744728.969444:0:13275:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788744728.969448:0:13275:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff93a23c698000) has no exports 00000020:00000080:0.0:1788744728.969474:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744728.969480:0:13275:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788744728.969483:0:13275:0:(genops.c:885:class_export_put()) final put ffff93a2065f5800/OSS_uuid 00000020:00000080:0.0:1788744728.969485:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff93a2065f5800/OSS_uuid for OSS 00000020:01000000:0.0:1788744728.969489:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788744728.969570:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff93a203ff0800:6682] 0 exiting: rc = 1 00000100:00100000:1.0:1788744728.969703:0:12018:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff93a10698a000:12018] 4 exiting: rc = 0 00000100:00100000:1.0:1788744728.969778:0:6684:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff93a203f40a00:6684] 1 exiting: rc = 0 00000100:00100000:1.0:1788744728.969825:0:9032:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff93a23d37d400:9032] 3 exiting: rc = 0 00000100:00080000:3.0:1788744728.974539:0:5836:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788744728.974747:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff93a229c4e200:6685] 2 exiting: rc = 0 00000100:00100000:0.0:1788744728.975093:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975111:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975120:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975231:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975241:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975246:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975252:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975257:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975262:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975267:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975272:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975278:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975284:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975290:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975294:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975300:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975306:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975311:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975318:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975322:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975328:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975332:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975338:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975343:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975348:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975353:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975359:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975364:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975372:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975377:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975382:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975387:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975394:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975399:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975405:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975410:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975414:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975419:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975431:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975435:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975440:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975445:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975450:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975455:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975460:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975465:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975472:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975477:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975483:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975489:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975496:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975503:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975508:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975513:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975518:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975523:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975530:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975535:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975540:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975545:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975550:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975555:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975560:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.975565:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744728.977833:0:6686:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93a23f8e9800:6686] 0 exiting: rc = 1 00000100:00100000:3.0:1788744728.977915:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93a23f8e8400:6687] 1 exiting: rc = 0 00000100:00100000:0.0:1788744728.978180:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978189:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978194:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978199:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978204:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978209:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978214:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978219:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978223:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978236:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978241:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978246:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978251:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978256:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978261:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978267:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978272:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978277:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978283:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978304:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978311:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978316:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978320:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978326:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978330:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978335:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978339:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978344:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978350:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978355:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978361:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978367:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978373:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978378:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978384:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978390:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978395:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978401:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978406:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978411:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978416:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978421:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978426:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978430:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978442:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978447:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978452:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978457:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978462:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978467:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978472:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978477:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978481:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978486:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978491:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978496:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978502:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978508:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978512:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978518:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978522:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978527:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978532:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.978543:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744728.981078:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93a20749a800:6688] 0 exiting: rc = 1 00000100:00100000:3.0:1788744728.981336:0:6689:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93a204e75e00:6689] 1 exiting: rc = 0 00000100:00100000:0.0:1788744728.981569:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93a204e75200:6690] 2 exiting: rc = 0 00000100:00100000:0.0:1788744728.981711:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.981956:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.981963:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.981968:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.981974:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.981980:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.981985:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.981992:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.981997:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982003:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982009:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982014:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982019:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982026:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982047:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982053:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982059:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982064:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982070:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982077:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982083:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982101:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982108:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982113:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982118:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982123:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982158:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982230:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982237:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982243:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982248:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982254:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982259:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982265:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982272:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982277:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982282:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982288:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982294:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982299:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982306:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982313:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982319:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982324:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982330:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982349:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982356:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982361:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982366:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982378:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982383:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982389:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982394:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982400:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982405:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982410:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982416:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982421:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982427:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982432:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982438:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982444:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982450:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.982465:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744728.991799:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93a204e75c00:6691] 0 exiting: rc = 1 00000100:00100000:3.0:1788744728.991907:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93a23ccd2800:6692] 1 exiting: rc = 0 00000100:00100000:0.0:1788744728.991984:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.991992:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.991998:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992003:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992008:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992014:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992019:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992024:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992029:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992034:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992046:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992053:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992059:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992064:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992069:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992073:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992078:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992082:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992087:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992092:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992110:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992115:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992121:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992125:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992191:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992197:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992202:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992207:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992212:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992216:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992221:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992227:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992232:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992237:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992242:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992246:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992251:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992255:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992260:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992266:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992273:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992278:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992283:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992288:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992292:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992297:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992302:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992307:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992312:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992317:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992322:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992327:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992332:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992336:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992341:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992356:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992361:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992366:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992371:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992376:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992381:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992386:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992391:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.992396:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744728.993990:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93a23ccd2e00:6693] 0 exiting: rc = 1 00000100:00100000:1.0:1788744728.995499:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93a104b17e00:6694] 1 exiting: rc = 0 00000100:00100000:0.0:1788744728.995615:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.995623:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.995629:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.995634:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.995666:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.995674:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.995680:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.995686:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.995693:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.995700:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.995706:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.995997:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996008:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996014:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996021:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996027:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996049:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996057:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996064:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996071:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996078:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996085:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996090:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996096:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996101:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996107:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996153:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996238:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996261:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996268:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996274:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996280:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996286:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996293:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996300:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996307:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996313:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996319:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996325:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996331:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996353:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996360:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996366:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996372:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996377:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996382:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996388:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996394:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996401:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996407:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996412:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996418:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996437:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996446:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996452:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996460:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996660:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996668:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996674:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996679:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996685:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996700:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996706:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744728.996955:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788744729.013659:0:13275:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788744746.722038:0:13887:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788744755.262927:0:14348:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788744755.262934:0:14348:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788744755.263080:0:14348:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93a23bd31800 00000020:01000004:3.0:1788744755.263100:0:14348:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788744755.263109:0:14348:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788744755.263126:0:14348:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff93a10625b380) 00000020:00000080:3.0:1788744755.263170:0:14348:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788744755.284125:0:14348:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788744755.286777:0:14348:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1788744755.287702:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:1.0:1788744755.288106:0:14348:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788744755.289316:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:1.0:1788744755.289550:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:1.0:1788744755.289657:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1788744755.289754:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1788744755.289854:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1788744755.290434:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:1.0:1788744755.293719:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 304: rc = 0 00100000:10000000:1.0:1788744755.293826:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 304: rc = 0 00100000:10000000:1.0:1788744755.296724:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 643: rc = 0 00100000:10000000:1.0:1788744755.297230:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00100000:10000000:1.0:1788744755.297621:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:1.0:1788744755.297882:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 643: rc = 0 00100000:10000000:1.0:1788744755.298287:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:1.0:1788744755.298860:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 643: rc = 0 00100000:10000000:1.0:1788744755.299389:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 643: rc = 0 00100000:10000000:1.0:1788744755.299686:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 643: rc = 0 00100000:10000000:1.0:1788744755.299901:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 643: rc = 0 00100000:10000000:1.0:1788744755.300325:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 643: rc = 0 00100000:10000000:1.0:1788744755.300624:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 643: rc = 0 00100000:10000000:1.0:1788744755.300847:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 643: rc = 0 00100000:10000000:1.0:1788744755.301724:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 601: rc = 0 00100000:10000000:1.0:1788744755.301983:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 601: rc = 0 00100000:10000000:1.0:1788744755.302284:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 601: rc = 0 00100000:10000000:1.0:1788744755.302559:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 601: rc = 0 00100000:10000000:1.0:1788744755.302847:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 601: rc = 0 00100000:10000000:1.0:1788744755.303176:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 601: rc = 0 00100000:10000000:1.0:1788744755.303836:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 601: rc = 0 00100000:10000000:1.0:1788744755.304094:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 601: rc = 0 00100000:10000000:1.0:1788744755.305634:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 601: rc = 0 00100000:10000000:1.0:1788744755.305935:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 601: rc = 0 00100000:10000000:1.0:1788744755.306781:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 601: rc = 0 00100000:10000000:1.0:1788744755.307039:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 601: rc = 0 00100000:10000000:1.0:1788744755.307357:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 601: rc = 0 00100000:10000000:1.0:1788744755.308107:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 601: rc = 0 00100000:10000000:1.0:1788744755.308769:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 601: rc = 0 00100000:10000000:1.0:1788744755.309227:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 601: rc = 0 00100000:10000000:1.0:1788744755.309558:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 601: rc = 0 00100000:10000000:1.0:1788744755.309820:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 601: rc = 0 00100000:10000000:1.0:1788744755.310323:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 601: rc = 0 00100000:10000000:1.0:1788744755.310659:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 601: rc = 0 00100000:10000000:1.0:1788744755.310903:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 601: rc = 0 00100000:10000000:1.0:1788744755.311600:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 601: rc = 0 00100000:10000000:1.0:1788744755.311934:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 601: rc = 0 00100000:10000000:1.0:1788744755.312256:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 601: rc = 0 00100000:10000000:1.0:1788744755.312593:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 601: rc = 0 00100000:10000000:1.0:1788744755.312868:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 601: rc = 0 00100000:10000000:1.0:1788744755.313119:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 601: rc = 0 00100000:10000000:1.0:1788744755.313601:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 601: rc = 0 00100000:10000000:1.0:1788744755.313877:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 601: rc = 0 00100000:10000000:1.0:1788744755.314122:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 601: rc = 0 00100000:10000000:1.0:1788744755.314739:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 601: rc = 0 00100000:10000000:1.0:1788744755.314977:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 601: rc = 0 00100000:10000000:1.0:1788744755.315882:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 100: rc = 0 00100000:10000000:1.0:1788744755.318782:0:14348:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788744755.319718:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 640: rc = 0 00100000:10000000:1.0:1788744755.319917:0:14348:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788744755.319987:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 640: rc = 0 00100000:10000000:1.0:1788744755.320274:0:14348:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788744755.320338:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 640: rc = 0 00100000:10000000:1.0:1788744755.320852:0:14348:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788744755.320919:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 305: rc = 0 00100000:10000000:1.0:1788744755.321333:0:14348:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788744755.321400:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 305: rc = 0 00100000:10000000:1.0:1788744755.321672:0:14348:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788744755.321738:0:14348:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 305: rc = 0 00000020:00000080:1.0:1788744755.322282:0:14348:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788744755.322291:0:14348:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788744755.322302:0:14348:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b162761eb392f1c 00000020:01000004:1.0:1788744755.322311:0:14348:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788744755.322317:0:14348:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788744755.322322:0:14348:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93a23bd31800 from MGS 00000020:01000004:1.0:1788744755.322326:0:14348:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788744755.322337:0:14348:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93a220a799c0) 00000020:00000080:1.0:1788744755.322346:0:14348:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788744755.322403:0:14348:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93a23bd31800 from MGS, refs=2 00080000:01000000:1.0:1788744755.322407:0:14348:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788744755.322413:0:14348:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b162761eb392f2a 00000100:00100000:1.0:1788744755.322582:0:14348:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788744755.322713:0:14348:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788744755.322719:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788744755.323499:0:14348:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788744755.323508:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788744755.324409:0:14348:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744755.324693:0:14348:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788744755.324698:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788744755.325374:0:14348:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788744755.325382:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788744755.325850:0:14348:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788744755.325857:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788744755.326907:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744755.326912:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744755.326914:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744755.327254:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744755.327256:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744755.327258:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744755.327901:0:14348:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788744755.331393:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788744755.345967:0:14348:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788744755.345988:0:14348:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788744755.345991:0:14348:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788744755.356006:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788744755.356392:0:14348:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788744755.356566:0:14348:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788744755.357174:0:14348:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788744755.357512:0:14348:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744755.357706:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788744755.357713:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788744755.361790:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788744755.361806:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788744755.364658:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788744755.364676:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788744755.366222:0:14348:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788744755.366250:0:14348:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.106@tcp' 00000020:01000004:3.0:1788744755.366252:0:14348:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788744755.366282:0:14348:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.106@tcp (typ=mgc) 00000020:00000080:3.0:1788744755.366299:0:14348:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.106@tcp (ffff93a10625cd40) 00000020:00000080:3.0:1788744755.366316:0:14348:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788744755.366409:0:14348:0:(ldlm_lib.c:103:import_set_conn()) imp ffff93a205cd1000@MGC192.168.201.106@tcp: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1788744755.366689:0:14348:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.106@tcp-0 is initialized 00000040:01000000:3.0:1788744755.366696:0:14348:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788744755.373370:0:14363:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788744755.373476:0:14348:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.106@tcp (uuid 85c0995c-9591-4016-879e-a5185771e142) 00000020:00000080:3.0:1788744755.373505:0:14348:0:(genops.c:1384:class_connect()) connect: client 85c0995c-9591-4016-879e-a5185771e142, cookie 0x4b162761eb392f38 00000100:00080000:3.0:1788744755.373519:0:14348:0:(import.c:545:import_select_connection()) MGC192.168.201.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744755.373531:0:14348:0:(import.c:666:import_select_connection()) MGC192.168.201.106@tcp: import ffff93a205cd1000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1788744755.373571:0:14348:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23c781500 x1875634475324160/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744755.373603:0:14348:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 85c0995c-9591-4016-879e-a5185771e142->MGS 00000020:01000004:3.0:1788744755.373630:0:14348:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788744755.373635:0:14348:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788744755.373649:0:14348:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff93a106258000) 00000020:00000080:3.0:1788744755.373660:0:14348:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:0.0:1788744755.373868:0:14362:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1788744755.374003:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:85c0995c-9591-4016-879e-a5185771e142:3306:1875634475324160:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788744755.374079:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744755.374372:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475324160 00000100:00100000:0.0:1788744755.374380:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475324160 00000100:00100000:0.0:1788744755.374416:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744755.374423:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2416dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1875634475324160:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788744755.374455:0:14359:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 85c0995c-9591-4016-879e-a5185771e142@0@lo t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:0.0:1788744755.374479:0:14359:0:(genops.c:1384:class_connect()) connect: client 85c0995c-9591-4016-879e-a5185771e142, cookie 0x4b162761eb392f46 00000100:00080000:0.0:1788744755.374607:0:14359:0:(import.c:65:import_set_state_nolock()) ffff93a107539000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744755.374661:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2416dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+5:3306:x1875634475324160:12345-0@lo:250:mount.lustre.0 Request processed in 236us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744755.374668:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744755.375020:0:3306:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788744755.375029:0:3306:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.106@tcp: connect to target with instance 0 00000100:00080000:2.0:1788744755.375035:0:3306:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788744755.375040:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788744755.375075:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a205cd1000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788744755.375077:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788744755.375085:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788744755.375090:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:85c0995c-9591-4016-879e-a5185771e142:3306:1875634475324160:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788744755.398625:0:14348:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744755.398799:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788744755.398804:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788744755.401390:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788744755.401401:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788744755.413346:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788744755.413364:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788744755.415357:0:14348:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744755.421243:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788744755.421254:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788744755.422835:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788744755.422847:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788744755.475973:0:14348:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744755.476280:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788744755.476287:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788744755.480166:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788744755.480193:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788744755.481424:0:14348:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744755.481632:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788744755.481636:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788744755.482472:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788744755.482480:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788744755.483707:0:14348:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744755.483835:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788744755.483843:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788744755.485691:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788744755.485705:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788744755.486565:0:14348:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744755.486754:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788744755.486759:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788744755.487361:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788744755.487369:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788744755.510046:0:14348:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744755.510466:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788744755.510475:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788744755.512169:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788744755.512193:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788744755.513095:0:14348:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788744755.513104:0:14348:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788744755.514555:0:14348:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788744755.514589:0:14348:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788744755.514595:0:14348:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788744755.514758:0:14348:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788744755.514796:0:14348:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.106@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788744755.514800:0:14348:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788744755.514802:0:14348:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744755.514804:0:14348:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744755.514805:0:14348:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744755.514806:0:14348:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744755.514808:0:14348:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744755.514809:0:14348:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744755.514811:0:14348:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744755.514813:0:14348:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744755.514814:0:14348:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788744755.514818:0:14348:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788744755.514820:0:14348:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788744755.514821:0:14348:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744755.514823:0:14348:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744755.514823:0:14348:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744755.514825:0:14348:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744755.514826:0:14348:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744755.514827:0:14348:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744755.514828:0:14348:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744755.514828:0:14348:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744755.514829:0:14348:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788744755.514955:0:14348:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788744755.514987:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475324288:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788744755.515089:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744755.516488:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203fe3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744755.517454:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475324288 00000100:00100000:0.0:1788744755.517469:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475324288 00000100:00100000:0.0:1788744755.517597:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744755.517609:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2416dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+5:14348:x1875634475324288:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788744755.517664:0:14361:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788744755.517668:0:14361:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788744755.517671:0:14361:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788744755.518308:0:14382:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788744755.518761:0:14361:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788744755.520416:0:14383:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788744755.520423:0:14383:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788744755.520427:0:14383:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788744755.520463:0:14383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788744755.521064:0:14361:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788744755.521078:0:14361:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788744755.533521:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2416dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+5:14348:x1875634475324288:12345-0@lo:253:mount.lustre.0 Request processed in 15900us (18417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744755.533557:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475324288:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788744755.533565:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:3.0:1788744755.533583:0:14348:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788744755.533587:0:14348:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788744755.533590:0:14348:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744755.533591:0:14348:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744755.533592:0:14348:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744755.533594:0:14348:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744755.533595:0:14348:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744755.533596:0:14348:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744755.533598:0:14348:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744755.533600:0:14348:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744755.533601:0:14348:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788744755.533629:0:14348:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93a23bd31800 from lustre-MDT0000 10000000:01000000:3.0:1788744755.533672:0:14348:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788744755.533676:0:14348:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788744755.533682:0:14348:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93a10625cd40 10000000:01000000:3.0:1788744755.533687:0:14348:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744755.533699:0:14348:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93a10625cd40 from 1 10000000:01000000:3.0:1788744755.533703:0:14348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788744755.533758:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81600/0x4b162761eb392f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.533770:0:14348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a107e81600/0x4b162761eb392f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.533780:0:14348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a107e81600/0x4b162761eb392f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744755.533804:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475324416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744755.533858:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744755.533958:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203fe3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788744755.536841:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475324416 00000100:00100000:0.0:1788744755.536867:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475324416 00000100:00100000:0.0:1788744755.536964:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744755.536981:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2416de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+5:14348:x1875634475324416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744755.537019:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744755.537052:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a23d17fe00/0x4b162761eb392f54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb392f4d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744755.537093:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23d17fe00/0x4b162761eb392f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb392f4d expref: 6 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744755.537114:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a23d17fe00/0x4b162761eb392f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb392f4d expref: 6 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744755.537125:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17fe00, rc 0) 00000100:00100000:0.0:1788744755.537444:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2416de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+6:14348:x1875634475324416:12345-0@lo:101:mount.lustre.0 Request processed in 467us (3585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744755.537449:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744755.537648:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475324416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744755.537670:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a107e81600/0x4b162761eb392f4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392f54 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.537679:0:14348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a107e81600/0x4b162761eb392f4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb392f54 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744755.537792:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475324544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744755.537831:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744755.537887:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203fe3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788744755.538103:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475324544 00000100:00100000:0.0:1788744755.538116:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475324544 00000100:00100000:0.0:1788744755.538209:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744755.538219:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2416ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+6:14348:x1875634475324544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744755.538787:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2416ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+6:14348:x1875634475324544:12345-0@lo:501:mount.lustre.0 Request processed in 569us (955us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788744755.538792:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744755.545502:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475324544:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788744755.545597:0:14348:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788744755.546070:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81600/0x4b162761eb392f4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392f54 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.546088:0:14348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a107e81600/0x4b162761eb392f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392f54 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744755.546102:0:14348:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93a23bd31800 10000000:01000000:3.0:1788744755.546117:0:14348:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788744755.546125:0:14348:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93a23bd31800 10000000:01000000:3.0:1788744755.546222:0:14348:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788744755.546227:0:14348:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93a23bd31800 from 1 10000000:01000000:3.0:1788744755.546230:0:14348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788744755.546289:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80000/0x4b162761eb392f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.546326:0:14348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a107e80000/0x4b162761eb392f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.546344:0:14348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a107e80000/0x4b162761eb392f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744755.546373:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475324672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744755.546716:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744755.546816:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203fe3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788744755.551102:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475324672 00000100:00100000:0.0:1788744755.551256:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475324672 00000100:00100000:1.0:1788744755.551586:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744755.551597:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2416df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+6:14348:x1875634475324672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744755.551623:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744755.551650:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a23051aa00/0x4b162761eb392f62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb392f5b expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.551680:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23051aa00/0x4b162761eb392f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb392f5b expref: 7 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.551689:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a23051aa00/0x4b162761eb392f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb392f5b expref: 7 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.551696:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051aa00, rc 0) 00000100:00100000:1.0:1788744755.551783:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2416df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+7:14348:x1875634475324672:12345-0@lo:101:mount.lustre.0 Request processed in 188us (5069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744755.551790:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744755.551864:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475324672:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744755.551892:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a107e80000/0x4b162761eb392f5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392f62 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.551904:0:14348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a107e80000/0x4b162761eb392f5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb392f62 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744755.551930:0:14348:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788744755.552077:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80000/0x4b162761eb392f5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392f62 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.552088:0:14348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a107e80000/0x4b162761eb392f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392f62 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744755.552098:0:14348:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788744755.552115:0:14348:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744755.552121:0:14348:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93a23bd31800 10000000:01000000:3.0:1788744755.552125:0:14348:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788744755.552173:0:14348:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788744755.552187:0:14348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788744755.552225:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81000/0x4b162761eb392f69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.552233:0:14348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a107e81000/0x4b162761eb392f69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.552242:0:14348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a107e81000/0x4b162761eb392f69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744755.552265:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475324800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744755.552308:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744755.552346:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203fe3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788744755.552603:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475324800 00000100:00100000:0.0:1788744755.552610:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475324800 00000100:00100000:1.0:1788744755.552726:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744755.552736:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2416df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+7:14348:x1875634475324800:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744755.552746:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744755.552758:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a23051a600/0x4b162761eb392f70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb392f69 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.552778:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23051a600/0x4b162761eb392f70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb392f69 expref: 8 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.552788:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a23051a600/0x4b162761eb392f70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb392f69 expref: 8 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.552808:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051a600, rc 0) 00000100:00100000:1.0:1788744755.552848:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2416df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+8:14348:x1875634475324800:12345-0@lo:101:mount.lustre.0 Request processed in 109us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744755.552855:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744755.552877:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475324800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744755.552890:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a107e81000/0x4b162761eb392f69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392f70 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.552899:0:14348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a107e81000/0x4b162761eb392f69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb392f70 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744755.552965:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475324928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744755.553559:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744755.553593:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203fe3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788744755.553661:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475324928 00000100:00100000:2.0:1788744755.553667:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475324928 00000100:00100000:2.0:1788744755.553743:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744755.553752:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2416de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+8:14348:x1875634475324928:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744755.555094:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2416de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+9:14348:x1875634475324928:12345-0@lo:501:mount.lustre.0 Request processed in 1338us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744755.555105:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788744755.555525:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475324928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744755.555607:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475325056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744755.555666:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744755.555724:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203fe3000 going to sleep for 11 seconds 00000100:00100000:1.0:1788744755.555834:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475325056 00000100:00100000:1.0:1788744755.555841:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475325056 00000100:00100000:1.0:1788744755.555912:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744755.555927:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+9:14348:x1875634475325056:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744755.556419:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+9:14348:x1875634475325056:12345-0@lo:503:mount.lustre.0 Request processed in 495us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744755.556427:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788744755.556544:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475325056:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744755.557779:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85c0995c-9591-4016-879e-a5185771e142:14384:1875634475325184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744755.557861:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744755.557921:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c40bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744755.558552:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475325184 00000100:00100000:2.0:1788744755.558565:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475325184 00000100:00100000:2.0:1788744755.558633:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744755.558644:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+9:14384:x1875634475325184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744755.559044:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+9:14384:x1875634475325184:12345-0@lo:502:llog_process_th.0 Request processed in 401us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744755.559052:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788744755.559087:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85c0995c-9591-4016-879e-a5185771e142:14384:1875634475325184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744755.559299:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744755.559397:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744755.559401:0:14384:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788744755.559407:0:14384:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788744755.559410:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744755.559427:0:14384:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff93a220a7cd40) 00000020:00000080:1.0:1788744755.559452:0:14384:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788744755.559523:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788744755.559663:0:14384:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788744755.559672:0:14384:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b162761eb392f7e 00000020:00000080:1.0:1788744755.559884:0:14384:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788744755.559890:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744755.559894:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744755.560020:0:14384:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788744755.560027:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744755.560032:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744755.560033:0:14384:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788744755.560036:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744755.560054:0:14384:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff93a220a7b380) 00000020:00000080:1.0:1788744755.560064:0:14384:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788744755.560070:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788744755.560072:0:14384:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788744755.560075:0:14384:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788744755.560081:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788744755.561097:0:14384:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93a23bd31800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788744755.561118:0:14384:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff93a220a78000) 00000020:00000080:1.0:1788744755.561155:0:14384:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788744755.561223:0:14384:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788744755.561232:0:14384:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b162761eb392f93 00000020:00000080:1.0:1788744755.561358:0:14384:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788744755.561365:0:14384:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788744755.561369:0:14384:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4b162761eb392f9a 00080000:01000000:1.0:1788744755.561374:0:14384:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788744755.561378:0:14384:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b162761eb392fa1 00010000:00010000:3.0:1788744755.650656:0:14384:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788744755.651053:0:14384:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788744755.651280:0:14384:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788744755.652356:0:14384:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff93a1062599c0) 00000020:00000080:3.0:1788744755.652440:0:14384:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788744755.652584:0:14384:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788744755.652593:0:14384:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b162761eb392faf 00000020:00000080:3.0:1788744755.653166:0:14384:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788744755.658826:0:14384:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4b162761eb392fb6 00000020:00000080:2.0:1788744755.659244:0:14384:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788744755.659257:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744755.659269:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744755.659271:0:14384:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788744755.659277:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744755.659282:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744755.659284:0:14384:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788744755.659288:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788744755.659322:0:14384:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788744755.659338:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744755.659341:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744755.659343:0:14384:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788744755.659346:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788744755.659348:0:14384:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1788744755.659350:0:14384:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788744755.659352:0:14384:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788744755.659354:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788744755.659357:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744755.659358:0:14384:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788744755.659361:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788744755.659365:0:14384:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788744755.659464:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744755.659465:0:14384:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788744755.659470:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788744755.659475:0:14384:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:2.0:1788744755.659501:0:14384:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788744755.659503:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788744755.659517:0:14384:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93a23c69b380) 00000020:00000080:2.0:1788744755.659597:0:14384:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788744755.659603:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788744755.659653:0:14384:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788744755.659659:0:14384:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788744755.659665:0:14384:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b162761eb392fc4 00010000:00080000:2.0:1788744755.659700:0:14384:0:(ldlm_lib.c:103:import_set_conn()) imp ffff93a241d5a000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:2.0:1788744755.659957:0:14384:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788744755.660437:0:14384:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788744755.660484:0:14384:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788744755.661731:0:14384:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744755.661783:0:14384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788744755.661839:0:14384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788744755.662723:0:14388:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788744755.662729:0:14388:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788744755.663264:0:14384:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788744755.663275:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788744755.663306:0:14384:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788744755.663324:0:14384:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b162761eb392fcb 00000100:00080000:2.0:1788744755.663334:0:14384:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788744755.663345:0:14384:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93a241d5a000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1788744755.663594:0:14384:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23c9b3100 x1875634475325312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744755.663660:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475325312:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788744755.663709:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634475325312 offset 0 length 520: 4 00000100:00080000:2.0:1788744755.663767:0:14384:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788744755.663825:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744755.663829:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744755.663832:0:14384:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788744755.663835:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788744755.663838:0:14384:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788744755.663840:0:14384:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788744755.663842:0:14384:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788744755.663844:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788744755.663847:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744755.663848:0:14384:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788744755.663851:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788744755.663856:0:14384:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788744755.663859:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744755.663861:0:14384:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788744755.663864:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788744755.663869:0:14384:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:2.0:1788744755.663889:0:14384:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788744755.663891:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788744755.663908:0:14384:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93a23c69cd40) 00000020:00000080:2.0:1788744755.663921:0:14384:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788744755.663926:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788744755.663984:0:14384:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788744755.663989:0:14384:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788744755.663995:0:14384:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b162761eb392fd9 00010000:00080000:2.0:1788744755.664021:0:14384:0:(ldlm_lib.c:103:import_set_conn()) imp ffff93a204f17000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:2.0:1788744755.664278:0:14384:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788744755.664463:0:14384:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788744755.664485:0:14384:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788744755.664954:0:14384:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744755.665016:0:14384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788744755.665088:0:14384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788744755.665726:0:14390:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788744755.665731:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788744755.666492:0:14384:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788744755.666503:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788744755.666665:0:14384:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788744755.666687:0:14384:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b162761eb392fe0 00000100:00080000:2.0:1788744755.666697:0:14384:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788744755.666708:0:14384:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93a204f17000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1788744755.666744:0:14384:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23c9b1500 x1875634475325440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788744755.666908:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475325440:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788744755.666962:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634475325440 offset 0 length 520: 4 00000100:00080000:2.0:1788744755.667007:0:14384:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788744755.667122:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744755.667127:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744755.667148:0:14384:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788744755.667159:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744755.667163:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744755.667166:0:14384:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788744755.667169:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788744755.667171:0:14384:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788744755.667173:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744755.667186:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744755.667188:0:14384:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788744755.667191:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744755.667193:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744755.667194:0:14384:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788744755.667198:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788744755.667230:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85c0995c-9591-4016-879e-a5185771e142:14384:1875634475325568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744755.667276:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744755.667307:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220a75840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744755.667345:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475325568 00000100:00100000:1.0:1788744755.667354:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475325568 00000100:00100000:1.0:1788744755.667408:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744755.667418:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d600c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+9:14384:x1875634475325568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744755.667957:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d600c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+9:14384:x1875634475325568:12345-0@lo:502:llog_process_th.0 Request processed in 540us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744755.667967:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788744755.667993:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85c0995c-9591-4016-879e-a5185771e142:14384:1875634475325568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744755.668023:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744755.668027:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744755.668030:0:14384:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788744755.668035:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788744755.668819:0:14348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788744755.668842:0:14348:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788744755.668861:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81000/0x4b162761eb392f69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392f70 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.668874:0:14348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a107e81000/0x4b162761eb392f69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392f70 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744755.668890:0:14348:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93a23bd31800 from 1 10000000:01000000:1.0:1788744755.668893:0:14348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788744755.668926:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23051ac00/0x4b162761eb392fe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.668934:0:14348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23051ac00/0x4b162761eb392fe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.668944:0:14348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23051ac00/0x4b162761eb392fe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744755.668963:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d356d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475325696:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788744755.669005:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744755.669046:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203395780 going to sleep for 11 seconds 00000100:00100000:2.0:1788744755.669049:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475325696 00000100:00100000:2.0:1788744755.669057:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475325696 00000100:00100000:2.0:1788744755.669103:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788744755.669113:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+9:14348:x1875634475325696:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744755.669126:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744755.669265:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2064f3600/0x4b162761eb392fee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb392fe7 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744755.669297:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2064f3600/0x4b162761eb392fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb392fe7 expref: 10 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744755.669323:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2064f3600/0x4b162761eb392fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb392fe7 expref: 10 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744755.669333:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3600, rc 0) 00000100:00100000:2.0:1788744755.669462:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+10:14348:x1875634475325696:12345-0@lo:101:mount.lustre.0 Request processed in 350us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744755.669468:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744755.669547:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d356d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475325696:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744755.669563:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23051ac00/0x4b162761eb392fe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392fee expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744755.669574:0:14348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23051ac00/0x4b162761eb392fe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb392fee expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744755.670059:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475325824:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788744755.670096:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744755.670600:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204849e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744755.670678:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475325824 00000100:00100000:3.0:1788744755.670684:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475325824 00000100:00100000:3.0:1788744755.670755:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788744755.670764:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+10:14348:x1875634475325824:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788744755.670781:0:14360:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788744755.670788:0:14360:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788744755.670863:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+10:14348:x1875634475325824:12345-0@lo:256:mount.lustre.0 Request processed in 100us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744755.670870:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744755.670928:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475325824:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788744755.671587:0:14348:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788744755.671605:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23051ac00/0x4b162761eb392fe7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392fee expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744755.671617:0:14348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23051ac00/0x4b162761eb392fe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392fee expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744755.671637:0:14348:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a23bd31800 from 1 10000000:01000000:0.0:1788744755.671640:0:14348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744755.671667:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb392ff5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744755.671676:0:14348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb392ff5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744755.671685:0:14348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb392ff5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744755.671701:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475325952:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788744755.671735:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744755.672302:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204849e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744755.672416:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475325952 00000100:00100000:2.0:1788744755.672422:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475325952 00000100:00100000:2.0:1788744755.672450:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788744755.672457:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+10:14348:x1875634475325952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744755.672469:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744755.672482:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2064f2600/0x4b162761eb392ffc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb392ff5 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744755.672503:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2064f2600/0x4b162761eb392ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb392ff5 expref: 11 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744755.672514:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2064f2600/0x4b162761eb392ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb392ff5 expref: 11 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744755.672638:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2600, rc 0) 00000100:00100000:2.0:1788744755.672729:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+11:14348:x1875634475325952:12345-0@lo:101:mount.lustre.0 Request processed in 271us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744755.672736:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788744755.672827:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475325952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744755.672840:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb392ff5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392ffc expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744755.672850:0:14348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb392ff5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb392ffc expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744755.672903:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475326080:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744755.672932:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744755.672993:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204849e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744755.673021:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475326080 00000100:00100000:3.0:1788744755.673025:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475326080 00000100:00100000:3.0:1788744755.673049:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744755.673055:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+11:14348:x1875634475326080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744755.673779:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+11:14348:x1875634475326080:12345-0@lo:501:mount.lustre.0 Request processed in 722us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744755.673787:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788744755.673837:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475326080:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744755.673870:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475326208:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744755.673916:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744755.674004:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204849e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744755.674033:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475326208 00000100:00100000:2.0:1788744755.674042:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475326208 00000100:00100000:2.0:1788744755.674076:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788744755.674085:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+11:14348:x1875634475326208:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744755.674628:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+11:14348:x1875634475326208:12345-0@lo:503:mount.lustre.0 Request processed in 543us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744755.674636:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788744755.674694:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475326208:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744755.674968:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85c0995c-9591-4016-879e-a5185771e142:14392:1875634475326336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744755.675005:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744755.675070:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220a766c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744755.675099:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475326336 00000100:00100000:0.0:1788744755.675104:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475326336 00000100:00100000:0.0:1788744755.675261:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788744755.675271:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+11:14392:x1875634475326336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744755.675687:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+11:14392:x1875634475326336:12345-0@lo:502:llog_process_th.0 Request processed in 417us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744755.675694:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744755.675759:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85c0995c-9591-4016-879e-a5185771e142:14392:1875634475326336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744755.675783:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744755.675792:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744755.675795:0:14392:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788744755.675802:0:14392:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93a23bd31800 00000020:00000080:3.0:1788744755.675805:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744755.675812:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744755.675814:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744755.675815:0:14392:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788744755.675818:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744755.675820:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744755.675821:0:14392:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788744755.675825:0:14392:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93a23bd31800 00000020:00000080:3.0:1788744755.675827:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788744755.675887:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744755.675891:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744755.675892:0:14392:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788744755.675895:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744755.675897:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744755.675899:0:14392:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788744755.675902:0:14392:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93a23bd31800 00000020:00000080:3.0:1788744755.675904:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788744755.675939:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85c0995c-9591-4016-879e-a5185771e142:14392:1875634475326464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744755.675970:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744755.675990:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220a766c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744755.676224:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475326464 00000100:00100000:1.0:1788744755.676230:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475326464 00000100:00100000:1.0:1788744755.676255:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744755.676264:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+11:14392:x1875634475326464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744755.676451:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+11:14392:x1875634475326464:12345-0@lo:502:llog_process_th.0 Request processed in 187us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744755.676878:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744755.678607:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85c0995c-9591-4016-879e-a5185771e142:14392:1875634475326464:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744755.678647:0:14392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744755.678655:0:14392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744755.678657:0:14392:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788744755.678662:0:14392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788744755.679274:0:14348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788744755.679302:0:14348:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744755.679331:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb392ff5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392ffc expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.679344:0:14348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb392ff5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392ffc expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744755.679401:0:14348:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788744755.679405:0:14348:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93a23bd31800 10000000:01000000:1.0:1788744755.679407:0:14348:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93a23bd31800 10000000:01000000:1.0:1788744755.679412:0:14348:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788744755.679418:0:14348:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93a23bd31800 from 1 10000000:01000000:1.0:1788744755.679421:0:14348:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788744755.679462:0:14348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23051a200/0x4b162761eb393003 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.679470:0:14348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23051a200/0x4b162761eb393003 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.679481:0:14348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23051a200/0x4b162761eb393003 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744755.679503:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d356d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475326592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788744755.679565:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744755.679609:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203395480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744755.680216:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475326592 00000100:00100000:0.0:1788744755.680224:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475326592 00000100:00100000:0.0:1788744755.680276:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788744755.680285:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+11:14348:x1875634475326592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744755.680302:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744755.680319:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a23d17f800/0x4b162761eb39300a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb393003 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744755.680350:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23d17f800/0x4b162761eb39300a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb393003 expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744755.680362:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a23d17f800/0x4b162761eb39300a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb393003 expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744755.680472:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17f800, rc 0) 00000100:00100000:0.0:1788744755.681219:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+12:14348:x1875634475326592:12345-0@lo:101:mount.lustre.0 Request processed in 933us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744755.681235:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788744755.686290:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d356d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475326592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744755.686323:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23051a200/0x4b162761eb393003 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39300a expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.686337:0:14348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23051a200/0x4b162761eb393003 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb39300a expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744755.686441:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475326720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744755.686513:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744755.686604:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220a766c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744755.686691:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475326720 00000100:00100000:1.0:1788744755.686698:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475326720 00000100:00100000:1.0:1788744755.686783:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788744755.686794:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+12:14348:x1875634475326720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744755.687090:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+12:14348:x1875634475326720:12345-0@lo:501:mount.lustre.0 Request processed in 298us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744755.687098:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788744755.687342:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475326720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744755.687372:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475326848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744755.687406:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744755.687425:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220a766c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744755.687446:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475326848 00000100:00100000:0.0:1788744755.687452:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475326848 00000100:00100000:0.0:1788744755.687488:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788744755.687495:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+12:14348:x1875634475326848:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744755.687707:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+12:14348:x1875634475326848:12345-0@lo:503:mount.lustre.0 Request processed in 212us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744755.687715:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788744755.687731:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475326848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744755.688235:0:14396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85c0995c-9591-4016-879e-a5185771e142:14396:1875634475326976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744755.688276:0:14396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744755.688332:0:14396:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220a76300 going to sleep for 11 seconds 00000100:00100000:1.0:1788744755.688361:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475326976 00000100:00100000:1.0:1788744755.688365:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475326976 00000100:00100000:1.0:1788744755.688416:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788744755.688430:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+12:14396:x1875634475326976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744755.688672:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+12:14396:x1875634475326976:12345-0@lo:502:llog_process_th.0 Request processed in 241us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744755.688678:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788744755.688865:0:14396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85c0995c-9591-4016-879e-a5185771e142:14396:1875634475326976:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788744755.688916:0:14396:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788744755.688937:0:14396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93a21054b380) 00000020:00000080:3.0:1788744755.689020:0:14396:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788744755.689104:0:14396:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93a23bd31800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788744755.689108:0:14396:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93a23bd31800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788744755.689110:0:14396:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93a23bd31800 4 00010000:00080000:3.0:1788744755.689168:0:14396:0:(ldlm_lib.c:103:import_set_conn()) imp ffff93a203d9a000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1788744755.692356:0:14396:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788744755.692592:0:14396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788744755.692628:0:14396:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788744755.692642:0:14396:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4b162761eb393018 00000100:00080000:3.0:1788744755.692653:0:14396:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744755.692664:0:14396:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93a203d9a000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1788744755.692701:0:14396:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23c780e00 x1875634475327104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788744755.692760:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875634475327104:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788744755.692831:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788744755.692896:0:14396:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788744755.693016:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475327104 00000100:00100000:0.0:1788744755.693026:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475327104 00000100:00100000:0.0:1788744755.693057:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744755.693062:0:14396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85c0995c-9591-4016-879e-a5185771e142:14396:1875634475327232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744755.693067:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875634475327104:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788744755.693105:0:14396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744755.693155:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875634475327104:12345-0@lo:38:llog_process_th.0 Request processed in 89us (323us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788744755.693158:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475327232 00000100:00100000:3.0:1788744755.693163:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475327232 00000100:00100000:0.0:1788744755.693166:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744755.693218:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744755.693226:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a203d9a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744755.693230:0:3306:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788744755.693233:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875634475327104:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788744755.693276:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788744755.693285:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+12:14396:x1875634475327232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744755.693525:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+12:14396:x1875634475327232:12345-0@lo:502:llog_process_th.0 Request processed in 241us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744755.693533:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788744755.693570:0:14396:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220a76300 going to sleep for 11 seconds 00000100:00100000:3.0:1788744755.693583:0:14396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:85c0995c-9591-4016-879e-a5185771e142:14396:1875634475327232:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788744755.693603:0:14396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788744755.695192:0:14348:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788744755.695218:0:14348:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788744755.695242:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23051a200/0x4b162761eb393003 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39300a expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.695254:0:14348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23051a200/0x4b162761eb393003 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39300a expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788744755.695305:0:14348:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788744755.695307:0:14348:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744755.695309:0:14348:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744755.695310:0:14348:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744755.695311:0:14348:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744755.695313:0:14348:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744755.695314:0:14348:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744755.695315:0:14348:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744755.695317:0:14348:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744755.695319:0:14348:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788744755.695322:0:14348:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788744755.695325:0:14348:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788744755.695326:0:14348:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744755.695327:0:14348:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744755.695328:0:14348:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744755.695330:0:14348:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744755.695331:0:14348:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744755.695332:0:14348:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744755.695334:0:14348:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744755.695335:0:14348:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744755.695336:0:14348:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788744755.695356:0:14348:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788744755.695381:0:14348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475327360:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788744755.695434:0:14348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744755.695464:0:14348:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220a76300 going to sleep for 11 seconds 00000100:00100000:1.0:1788744755.696293:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475327360 00000100:00100000:1.0:1788744755.696300:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475327360 00000100:00100000:1.0:1788744755.696343:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744755.696352:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+12:14348:x1875634475327360:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788744755.696390:0:14360:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788744755.696405:0:14360:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788744755.735478:0:14360:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788744755.735499:0:14360:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788744755.735525:0:14382:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788744755.735531:0:14382:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788744755.735553:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93a23d17ec00/0x4b162761eb39301f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744755.735572:0:14382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a2064f3600/0x4b162761eb392fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb392fe7 expref: 12 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744755.735597:0:14382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93a23d17ec00/0x4b162761eb39301f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744755.735637:0:14382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a2064f3600/0x4b162761eb392fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb392fe7 expref: 12 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744755.735652:0:14382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93a2064f3600/0x4b162761eb392fee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb392fe7 expref: 12 pid: 14359 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744755.735668:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14382:1875634475327488:0@lo:104: 00000100:00100000:0.0:1788744755.735736:0:14382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744755.735792:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2048490c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744755.735890:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475327488 00000100:00100000:3.0:1788744755.735899:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475327488 00000100:00100000:3.0:1788744755.735946:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744755.735961:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85c0995c-9591-4016-879e-a5185771e142+3:14382:x1875634475327488:12345-0@lo:104: 00010000:00010000:3.0:1788744755.736002:0:14349:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a23051ac00/0x4b162761eb392fe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb392fee expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.736067:0:14349:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788744755.736074:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85c0995c-9591-4016-879e-a5185771e142+3:14382:x1875634475327488:12345-0@lo:104: Request processed in 115us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744755.736081:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788744755.736102:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744755.736108:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a23051ac00/0x4b162761eb392fe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb392fee expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.736116:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051ac00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:3.0:1788744755.736121:0:14355:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a23051ac00/0x4b162761eb392fe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb392fee expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.736148:0:14355:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a23051ac00/0x4b162761eb392fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb392fee expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744755.736157:0:14355:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a23051ac00/0x4b162761eb392fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb392fee expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744755.736163:0:14355:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744755.736202:0:14355:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a23051ac00/0x4b162761eb392fe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb392fee expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.736209:0:14355:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744755.736230:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a23051ac00/0x4b162761eb392fe7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb392fee expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.736248:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a23051ac00/0x4b162761eb392fe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb392fee expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.736264:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744755.736267:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744755.736269:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744755.736307:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85c0995c-9591-4016-879e-a5185771e142:3308:1875634475327616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744755.736333:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744755.736586:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14382:1875634475327488:0@lo:104: 00010000:00010000:0.0:1788744755.736605:0:14382:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93a23d17ec00/0x4b162761eb39301f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744755.736733:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475327616 00000100:00100000:1.0:1788744755.736740:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475327616 00010000:00010000:1.0:1788744755.736764:0:14351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a2064f3600/0x4b162761eb392fee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb392fe7 expref: 13 pid: 14359 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744755.736792:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744755.736801:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85c0995c-9591-4016-879e-a5185771e142+13:3308:x1875634475327616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744755.736813:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744755.736818:0:14351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a2064f3600/0x4b162761eb392fee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb392fe7 expref: 13 pid: 14359 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.736829:0:14351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a2064f3600/0x4b162761eb392fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb392fe7 expref: 13 pid: 14359 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.736843:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2064f3600/0x4b162761eb392fee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb392fe7 expref: 13 pid: 14359 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.736857:0:14351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93a23d17ec00/0x4b162761eb39301f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.736880:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23d17ec00/0x4b162761eb39301f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788744755.736894:0:14351:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001364653s 00010000:00010000:1.0:1788744755.736899:0:14351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a23d17ec00/0x4b162761eb39301f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.736907:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a23d17ec00/0x4b162761eb39301f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.736913:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93a23d17ec00/0x4b162761eb39301f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.736921:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93a23d17ec00/0x4b162761eb39301f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.736926:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ec00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744755.736930:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93a23d17ec00/0x4b162761eb39301f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.736937:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93a23d17ec00/0x4b162761eb39301f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.736957:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93a23d17ec00/0x4b162761eb39301f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744755.736967:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744755.736975:0:14382:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93a23d17ec00/0x4b162761eb39301f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.736986:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93a23d17ec00/0x4b162761eb39301f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744755.736994:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a23d17ec00/0x4b162761eb39301f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744755.737017:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85c0995c-9591-4016-879e-a5185771e142+12:3308:x1875634475327616:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744755.737027:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744755.737071:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85c0995c-9591-4016-879e-a5185771e142:3308:1875634475327616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744755.741551:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+11:14348:x1875634475327360:12345-0@lo:253:mount.lustre.0 Request processed in 45190us (46107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744755.741566:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744755.741578:0:14348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:14348:1875634475327360:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788744755.741596:0:14348:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788744755.741600:0:14348:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788744755.741602:0:14348:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788744755.741604:0:14348:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744755.741605:0:14348:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744755.741607:0:14348:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744755.741609:0:14348:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744755.741611:0:14348:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788744755.741612:0:14348:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788744755.741614:0:14348:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744755.741615:0:14348:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788744755.741627:0:14348:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788744755.746033:0:14348:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788744755.746240:0:14348:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788744755.746930:0:14348:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788744755.747090:0:14348:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788744755.747586:0:14348:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788744755.747744:0:14348:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788744755.748750:0:14348:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788744755.748914:0:14348:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788744755.749287:0:14348:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788744755.749645:0:14348:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788744755.749916:0:14348:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788744755.750070:0:14348:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788744755.766356:0:14348:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788744755.766758:0:14348:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788744755.766773:0:14404:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788744755.766779:0:14404:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788744755.766985:0:14405:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788744755.767301:0:14405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788744755.768977:0:14348:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788744755.769096:0:14348:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788744755.770702:0:14348:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788744755.770716:0:14348:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788744755.770913:0:14348:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744755.771570:0:14405:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788744755.771677:0:14405:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788744755.771682:0:14405:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1788744755.773785:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788744755.774375:0:14348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788744755.774405:0:14348:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788744755.775061:0:14348:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1788744755.776606:0:14348:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788744755.785523:0:14348:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788744755.834988:0:14348:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788744755.835030:0:14348:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa3c581c33988 00100000:10000000:2.0:1788744755.835039:0:14348:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788744755.836328:0:14348:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788744755.836346:0:14348:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788744755.836363:0:14348:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788744755.836393:0:14348:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788744756.340504:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744756.729383:0:14400:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744756.729394:0:14400:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744756.729963:0:14400:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788744756.729973:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1788744757.182554:0:14363:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788744757.182563:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93a23bd31800 from 6 10000000:01000000:0.0:1788744757.182568:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788744757.182617:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb393026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744757.182630:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb393026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744757.182653:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb393026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744757.182681:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475327744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744757.182753:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744757.182805:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204849cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744757.185056:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475327744 00000100:00100000:3.0:1788744757.185072:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475327744 00000100:00100000:3.0:1788744757.185172:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788744757.185184:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+11:14363:x1875634475327744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744757.185202:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744757.185223:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e80400/0x4b162761eb39302d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb393026 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744757.185258:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e80400/0x4b162761eb39302d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb393026 expref: 12 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744757.185269:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e80400/0x4b162761eb39302d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb393026 expref: 12 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744757.185278:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80400, rc 0) 00000100:00100000:3.0:1788744757.185370:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+12:14363:x1875634475327744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (2617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744757.185377:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788744757.185433:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475327744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744757.185449:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb393026 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39302d expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744757.185459:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb393026 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb39302d expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744757.185530:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c782a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475327872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788744757.185574:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744757.185602:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23f861cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744757.185615:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475327872 00000100:00100000:3.0:1788744757.185619:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475327872 00000100:00100000:3.0:1788744757.185643:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788744757.185649:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+12:14363:x1875634475327872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788744757.185663:0:14360:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788744757.185678:0:14360:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788744757.185681:0:14360:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788744757.185757:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+12:14363:x1875634475327872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744757.185765:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788744757.185794:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c782a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475327872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788744757.185831:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788744757.185838:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb393026 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39302d expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744757.185847:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb393026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39302d expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744757.366168:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744757.748363:0:14400:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744757.748375:0:14400:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744757.748490:0:14400:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788744757.748500:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788744758.396099:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744759.417691:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788744760.260681:0:14648:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788744760.438437:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788744761.156746:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744761.156754:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744761.156756:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744761.156759:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744761.156762:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788744761.156765:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788744761.156769:0:36:0:(import.c:65:import_set_state_nolock()) ffff93a203d9a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744761.156793:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93a203d9a000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1788744761.156816:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23c9b3480 x1875634475328128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788744761.156881:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744761.156893:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85c0995c-9591-4016-879e-a5185771e142:3310:1875634475328000:0@lo:400:kworker.0 00000100:00100000:1.0:1788744761.158192:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875634475328128:0@lo:38:kworker.0 00000100:00100000:1.0:1788744761.158262:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744761.158314:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475328128 00000100:00100000:0.0:1788744761.158324:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475328128 00000100:00100000:0.0:1788744761.158360:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744761.158368:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875634475328128:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788744761.158395:0:14368:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:0.0:1788744761.158429:0:14368:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4b162761eb393034 00000004:00100000:0.0:1788744761.158443:0:14368:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788744761.158797:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744761.158835:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475328000 00000100:00100000:2.0:1788744761.158839:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475328000 00000100:00100000:2.0:1788744761.158871:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788744761.158877:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+12:3310:x1875634475328000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744761.158920:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+12:3310:x1875634475328000:12345-0@lo:400:kworker.0 Request processed in 44us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744761.158927:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788744761.160279:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85c0995c-9591-4016-879e-a5185771e142:3310:1875634475328000:0@lo:400:kworker.0 00000100:00080000:0.0:1788744761.160426:0:14368:0:(import.c:65:import_set_state_nolock()) ffff93a203f6a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744761.160488:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875634475328128:12345-0@lo:38:kworker.0 Request processed in 2119us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744761.160496:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788744761.161689:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93a23c9b3480 x1875634475328128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788744761.161708:0:3306:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788744761.161717:0:3306:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788744761.161721:0:3306:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788744761.161724:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a203d9a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788744761.161730:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875634475328128:0@lo:38:kworker.0 00010000:00010000:3.0:1788744761.467191:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744762.486904:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744763.520197:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788744763.766743:0:14799:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce76486c0 20000000:00000080:3.0:1788744763.766771:0:14799:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93a210439c00 uarg=0000000000000000 20000000:01000000:3.0:1788744763.766806:0:14799:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788744763.766813:0:14799:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788744763.766817:0:14799:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788744763.774087:0:14800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788744763.774345:0:14799:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788744763.785683:0:14799:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788744763.785714:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93a107e81e00/0x4b162761eb39303b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744763.785734:0:14799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a2064f2600/0x4b162761eb392ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb392ff5 expref: 11 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744763.785743:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93a107e81e00/0x4b162761eb39303b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744763.785788:0:14799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a2064f2600/0x4b162761eb392ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb392ff5 expref: 11 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744763.785803:0:14799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93a2064f2600/0x4b162761eb392ffc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb392ff5 expref: 11 pid: 14359 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744763.785816:0:14799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c782a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14799:1875634475328256:0@lo:104: 00000100:00100000:3.0:1788744763.785880:0:14799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744763.786255:0:14799:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220a76d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744763.789489:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475328256 00000100:00100000:2.0:1788744763.789504:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475328256 00000100:00100000:2.0:1788744763.789564:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744763.789574:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85c0995c-9591-4016-879e-a5185771e142+3:14799:x1875634475328256:12345-0@lo:104: 00010000:00010000:2.0:1788744763.789599:0:14349:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb392ff5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb392ffc expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744763.789698:0:14349:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744763.789705:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85c0995c-9591-4016-879e-a5185771e142+3:14799:x1875634475328256:12345-0@lo:104: Request processed in 133us (3824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744763.789712:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788744763.789784:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744763.789792:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb392ff5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb392ffc expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744763.789801:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ea00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:1.0:1788744763.789805:0:14354:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb392ff5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb392ffc expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744763.789814:0:14354:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb392ff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb392ffc expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744763.789821:0:14354:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb392ff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb392ffc expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744763.789837:0:14354:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788744763.789877:0:14354:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb392ff5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb392ffc expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744763.789883:0:14354:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744763.789904:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb392ff5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb392ffc expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744763.789912:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb392ff5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb392ffc expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744763.789927:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744763.789929:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744763.789930:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744763.789943:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85c0995c-9591-4016-879e-a5185771e142:3310:1875634475328384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744763.789992:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744763.790057:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475328384 00000100:00100000:1.0:1788744763.790067:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475328384 00010000:00010000:1.0:1788744763.790088:0:14351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a2064f2600/0x4b162761eb392ffc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb392ff5 expref: 12 pid: 14359 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744763.790109:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744763.790115:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d354700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85c0995c-9591-4016-879e-a5185771e142+12:3310:x1875634475328384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744763.790125:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744763.790154:0:14351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a2064f2600/0x4b162761eb392ffc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb392ff5 expref: 12 pid: 14359 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744763.790164:0:14351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a2064f2600/0x4b162761eb392ffc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb392ff5 expref: 12 pid: 14359 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744763.790181:0:14351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93a107e81e00/0x4b162761eb39303b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744763.790189:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e81e00/0x4b162761eb39303b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744763.790204:0:14351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a107e81e00/0x4b162761eb39303b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744763.790211:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a107e81e00/0x4b162761eb39303b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744763.790217:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93a107e81e00/0x4b162761eb39303b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744763.790224:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93a107e81e00/0x4b162761eb39303b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744763.790228:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81e00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744763.790237:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93a107e81e00/0x4b162761eb39303b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744763.790245:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93a107e81e00/0x4b162761eb39303b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744763.790254:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93a107e81e00/0x4b162761eb39303b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744763.790263:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744763.790303:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d354700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85c0995c-9591-4016-879e-a5185771e142+12:3310:x1875634475328384:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744763.790309:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744763.790344:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:85c0995c-9591-4016-879e-a5185771e142:3310:1875634475328384:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744763.790678:0:14799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2064f2600/0x4b162761eb392ffc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb392ff5 expref: 11 pid: 14359 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744763.790691:0:14799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c782a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14799:1875634475328256:0@lo:104: 00010000:00010000:3.0:1788744763.790705:0:14799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93a107e81e00/0x4b162761eb39303b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744763.790724:0:14799:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93a107e81e00/0x4b162761eb39303b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744763.790730:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93a107e81e00/0x4b162761eb39303b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744763.790736:0:14799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a107e81e00/0x4b162761eb39303b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744764.535562:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788744764.920197:0:14363:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788744764.920208:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a23bd31800 from 10 10000000:01000000:2.0:1788744764.920214:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744764.920266:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393042 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744764.920278:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393042 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744764.920289:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393042 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744764.920318:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475328512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744764.920416:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744764.920472:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475328512 00000100:00100000:3.0:1788744764.920482:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475328512 00000100:00100000:2.0:1788744764.920490:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203fb60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744764.920544:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744764.920554:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+11:14363:x1875634475328512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744764.920572:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744764.920591:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e81e00/0x4b162761eb393049 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb393042 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744764.920617:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e81e00/0x4b162761eb393049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb393042 expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744764.920630:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e81e00/0x4b162761eb393049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb393042 expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744764.920638:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81e00, rc 0) 00000100:00100000:3.0:1788744764.920689:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+12:14363:x1875634475328512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744764.920695:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788744764.920784:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475328512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744764.920798:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393042 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb393049 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744764.920806:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393042 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb393049 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744764.920874:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475328640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744764.920899:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744764.920922:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203fb60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744764.921026:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475328640 00000100:00100000:3.0:1788744764.921037:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475328640 00000100:00100000:3.0:1788744764.921067:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788744764.921074:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+12:14363:x1875634475328640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744764.921376:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+12:14363:x1875634475328640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744764.921383:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744764.921590:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475328640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744764.921620:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d355c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475328768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744764.921655:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744764.921685:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220a6bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744764.921722:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475328768 00000100:00100000:2.0:1788744764.921727:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475328768 00000100:00100000:2.0:1788744764.921758:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788744764.921765:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+12:14363:x1875634475328768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744764.921905:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+12:14363:x1875634475328768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744764.921912:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788744764.921976:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d355c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475328768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788744764.923882:0:14832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788744764.923945:0:14363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788744764.923963:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744764.923973:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393042 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb393049 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744764.923985:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393042 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb393049 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744765.239362:0:3306:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744755/real 1788744755] req@ffff93a23c9b1500 x1875634475325440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744765 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744765.239410:0:3306:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93a23c9b1500 x1875634475325440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744765 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744765.239432:0:3306:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744755/real 1788744755] req@ffff93a23c9b3100 x1875634475325312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744765 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744765.239444:0:3306:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93a23c9b3100 x1875634475325312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744765 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788744765.239509:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a204f17000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744765.239528:0:3306:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788744765.239531:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475325440:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788744765.239537:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a241d5a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744765.239542:0:3306:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788744765.239545:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475325312:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788744765.240057:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744765.240063:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788744765.240066:0:38:0:(import.c:65:import_set_state_nolock()) ffff93a241d5a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744765.240072:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:3.0:1788744765.240077:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788744765.240087:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93a241d5a000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1788744765.240120:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23c782a00 x1875634475328896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744765.240169:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744765.240172:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788744765.240173:0:38:0:(import.c:65:import_set_state_nolock()) ffff93a204f17000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744765.240177:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:3.0:1788744765.240179:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788744765.240184:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93a204f17000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1788744765.240208:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23c781f80 x1875634475329024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788744765.240270:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475329152:0@lo:400:kworker.0 00000100:00100000:3.0:1788744765.240326:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744765.240405:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475329152 00000100:00100000:3.0:1788744765.240430:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475329152 00000100:00100000:3.0:1788744765.240475:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744765.240483:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475329152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744765.240531:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475329152:12345-0@lo:400:kworker.0 Request processed in 49us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744765.240538:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788744765.240574:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93a23c783100 x1875634475329152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744765.240586:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475329152:0@lo:400:kworker.0 00000100:00100000:1.0:1788744765.242785:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475328896:0@lo:8:kworker.0 00000400:00000100:1.0:1788744765.242840:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634475328896 offset 0 length 520: 4 00000100:00100000:1.0:1788744765.242874:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475329024:0@lo:8:kworker.0 00000400:00000100:1.0:1788744765.242896:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634475329024 offset 0 length 520: 4 00010000:00010000:1.0:1788744765.556681:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744766.581083:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744767.609075:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788744767.988395:0:14400:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744767.988405:0:14400:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744767.989000:0:14400:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788744767.989065:0:14400:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744767.989104:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:2.0:1788744768.629000:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788744769.358419:0:15047:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788744769.358424:0:15047:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788744769.358551:0:15047:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93a205178000 00000020:01000004:0.0:1788744769.358569:0:15047:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788744769.358582:0:15047:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788744769.358598:0:15047:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93a2064c19c0) 00000020:00000080:0.0:1788744769.358619:0:15047:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788744769.426999:0:15047:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788744769.427356:0:15047:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788744769.428121:0:15047:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788744769.428388:0:15047:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788744769.428594:0:15047:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788744769.429813:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 503: rc = 0 00100000:10000000:1.0:1788744769.429965:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 503: rc = 0 00100000:10000000:1.0:1788744769.430076:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 503: rc = 0 00100000:10000000:1.0:1788744769.430555:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:1.0:1788744769.430893:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00100000:10000000:1.0:1788744769.431199:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:1.0:1788744769.431435:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:1.0:1788744769.431692:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00100000:10000000:1.0:1788744769.431954:0:15047:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00000020:00000080:1.0:1788744769.432592:0:15047:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788744769.432603:0:15047:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788744769.432616:0:15047:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b162761eb393057 00000020:01000004:1.0:1788744769.432624:0:15047:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788744769.432644:0:15047:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788744769.432652:0:15047:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788744769.432658:0:15047:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788744769.432663:0:15047:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788744769.432675:0:15047:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93a23d668000) 00000020:00000080:1.0:1788744769.432686:0:15047:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788744769.445723:0:15047:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744769.445916:0:15047:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788744769.445923:0:15047:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788744769.454689:0:15047:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788744769.454705:0:15047:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788744769.455515:0:15047:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788744769.455524:0:15047:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788744769.458840:0:15047:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744769.459102:0:15047:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788744769.459109:0:15047:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788744769.460156:0:15047:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788744769.460170:0:15047:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788744769.488985:0:15047:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744769.489265:0:15047:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788744769.489271:0:15047:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788744769.491071:0:15047:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788744769.491084:0:15047:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788744769.491932:0:15047:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788744769.491953:0:15047:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788744769.500538:0:15047:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744769.500766:0:15047:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788744769.500773:0:15047:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788744769.509368:0:15047:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788744769.509385:0:15047:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788744769.570225:0:15047:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744769.570555:0:15047:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788744769.570565:0:15047:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788744769.571880:0:15047:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788744769.571892:0:15047:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788744769.572502:0:15047:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788744769.572533:0:15047:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788744769.572542:0:15047:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788744769.587901:0:15047:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788744769.588501:0:15047:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.106@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788744769.588506:0:15047:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788744769.588508:0:15047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788744769.588515:0:15047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744769.588516:0:15047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744769.588518:0:15047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744769.588519:0:15047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744769.588521:0:15047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788744769.588522:0:15047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744769.588523:0:15047:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788744769.588527:0:15047:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788744769.588530:0:15047:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788744769.588531:0:15047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788744769.588532:0:15047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744769.588533:0:15047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744769.588534:0:15047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744769.588535:0:15047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744769.588536:0:15047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788744769.588537:0:15047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744769.588538:0:15047:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788744769.588580:0:15047:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788744769.588603:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475329280:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788744769.588684:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744769.588761:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203fb5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744769.588877:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475329280 00000100:00100000:2.0:1788744769.588886:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475329280 00000100:00100000:2.0:1788744769.588953:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788744769.588972:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+12:15047:x1875634475329280:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788744769.589011:0:14361:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788744769.589014:0:14361:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788744769.589018:0:14361:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1788744769.652626:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744769.683717:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+12:15047:x1875634475329280:12345-0@lo:253:mount.lustre.0 Request processed in 94736us (95020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744769.683734:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788744769.683885:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475329280:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788744769.683902:0:15047:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788744769.683906:0:15047:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788744769.683907:0:15047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788744769.683909:0:15047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744769.683910:0:15047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744769.683911:0:15047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744769.683912:0:15047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744769.683914:0:15047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788744769.683915:0:15047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744769.683916:0:15047:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788744769.683999:0:15047:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93a205178000 from lustre-OST0000 10000000:01000000:0.0:1788744769.684034:0:15047:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788744769.684037:0:15047:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788744769.684044:0:15047:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93a10625cd40 local copy 00010000:00010000:0.0:1788744769.684054:0:15047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81600/0x4b162761eb392f4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392f54 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744769.684356:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475329408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744769.684406:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744769.684466:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744769.684596:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475329408 00000100:00100000:3.0:1788744769.684604:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475329408 00000100:00100000:3.0:1788744769.684643:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788744769.684653:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+12:15047:x1875634475329408:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744769.684826:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+12:15047:x1875634475329408:12345-0@lo:501:mount.lustre.0 Request processed in 175us (419us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744769.684834:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744769.685091:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475329408:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788744769.685106:0:15047:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788744769.685478:0:15047:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788744769.685485:0:15047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81600/0x4b162761eb392f4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392f54 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.685496:0:15047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a107e81600/0x4b162761eb392f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392f54 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744769.685521:0:15047:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93a205178000 10000000:01000000:0.0:1788744769.685525:0:15047:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788744769.685530:0:15047:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93a10625cd40 10000000:01000000:0.0:1788744769.685533:0:15047:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788744769.685537:0:15047:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93a10625cd40 from 1 10000000:01000000:0.0:1788744769.685540:0:15047:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788744769.685566:0:15047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb393065 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.685574:0:15047:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb393065 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.685583:0:15047:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb393065 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744769.685607:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475329536:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788744769.685638:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744769.685670:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744769.685736:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475329536 00000100:00100000:2.0:1788744769.685742:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475329536 00000100:00100000:2.0:1788744769.685779:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788744769.685786:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+12:15047:x1875634475329536:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744769.685799:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744769.685812:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2064f3000/0x4b162761eb39306c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb393065 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744769.685833:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2064f3000/0x4b162761eb39306c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb393065 expref: 13 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744769.685844:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2064f3000/0x4b162761eb39306c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb393065 expref: 13 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744769.685853:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3000, rc 0) 00000100:00100000:2.0:1788744769.685890:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+13:15047:x1875634475329536:12345-0@lo:101:mount.lustre.0 Request processed in 104us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744769.685897:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788744769.686256:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475329536:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744769.686269:0:15047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb393065 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39306c expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.686278:0:15047:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb393065 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb39306c expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744769.686296:0:15047:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788744769.686311:0:15047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb393065 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39306c expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.686317:0:15047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23d17ea00/0x4b162761eb393065 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39306c expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744769.686323:0:15047:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788744769.686327:0:15047:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788744769.686332:0:15047:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788744769.686334:0:15047:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788744769.686347:0:15047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e800/0x4b162761eb393073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.686354:0:15047:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23d17e800/0x4b162761eb393073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.686361:0:15047:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23d17e800/0x4b162761eb393073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744769.686378:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475329664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788744769.686404:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744769.686428:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744769.686489:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475329664 00000100:00100000:3.0:1788744769.686494:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475329664 00000100:00100000:3.0:1788744769.686524:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788744769.686533:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+13:15047:x1875634475329664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744769.686541:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744769.686549:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e81200/0x4b162761eb39307a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb393073 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744769.686562:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e81200/0x4b162761eb39307a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb393073 expref: 14 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744769.686570:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e81200/0x4b162761eb39307a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb393073 expref: 14 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744769.686577:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81200, rc 0) 00000100:00100000:3.0:1788744769.686609:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+14:15047:x1875634475329664:12345-0@lo:101:mount.lustre.0 Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744769.686615:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788744769.686757:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475329664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744769.686767:0:15047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23d17e800/0x4b162761eb393073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39307a expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.686774:0:15047:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23d17e800/0x4b162761eb393073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb39307a expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788744769.687926:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788744769.692780:0:15047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744769.693045:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788744769.693086:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788744769.693119:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788744769.693496:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788744769.693533:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788744769.693561:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788744769.693622:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788744769.693630:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788744769.693721:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475329792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744769.693788:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744769.693837:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578180 going to sleep for 11 seconds 00000100:00100000:3.0:1788744769.693988:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475329792 00000100:00100000:3.0:1788744769.693997:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475329792 00000100:00100000:3.0:1788744769.694045:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788744769.694054:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+14:15047:x1875634475329792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744769.694734:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+14:15047:x1875634475329792:12345-0@lo:501:mount.lustre.0 Request processed in 680us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744769.694754:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788744769.694862:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475329792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744769.694895:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475329920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744769.695098:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744769.695218:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578180 going to sleep for 11 seconds 00000100:00100000:1.0:1788744769.696757:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475329920 00000100:00100000:1.0:1788744769.696769:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475329920 00000100:00100000:1.0:1788744769.696828:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788744769.696839:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+14:15047:x1875634475329920:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744769.697510:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+14:15047:x1875634475329920:12345-0@lo:503:mount.lustre.0 Request processed in 671us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744769.697519:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788744769.697641:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475329920:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788744769.698670:0:15047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788744769.698745:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475330048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744769.698797:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744769.698892:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578180 going to sleep for 11 seconds 00000100:00100000:3.0:1788744769.707623:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475330048 00000100:00100000:3.0:1788744769.707649:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475330048 00000100:00100000:0.0:1788744769.707795:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788744769.707806:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+14:15047:x1875634475330048:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744769.708634:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+14:15047:x1875634475330048:12345-0@lo:502:mount.lustre.0 Request processed in 828us (9833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744769.708643:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788744769.708826:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475330048:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744769.709310:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788744769.709385:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788744769.709417:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788744769.709807:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788744769.709852:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788744769.709898:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788744769.712838:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788744769.712912:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788744769.713126:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788744769.713370:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788744769.713424:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788744769.713474:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788744769.713527:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475330176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744769.713621:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744769.713730:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a203fb6180 going to sleep for 11 seconds 00000100:00100000:3.0:1788744769.715536:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475330176 00000100:00100000:3.0:1788744769.715550:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475330176 00000100:00100000:0.0:1788744769.715672:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788744769.715683:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+14:15047:x1875634475330176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744769.715943:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+14:15047:x1875634475330176:12345-0@lo:502:mount.lustre.0 Request processed in 249us (2310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744769.715958:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744769.716313:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475330176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788744769.716428:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788744769.716444:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788744769.717453:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788744769.717461:0:15062:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788744769.717468:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744769.717470:0:15062:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788744769.717475:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788744769.717491:0:15062:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93a21054cd40) 00000020:00000080:3.0:1788744769.717514:0:15062:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788744769.717520:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788744769.717590:0:15062:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93a205178000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788744769.717597:0:15062:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788744769.717604:0:15062:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b162761eb393088 00010000:00010000:1.0:1788744769.727395:0:15062:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788744769.727825:0:15062:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788744769.732044:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788744769.735488:0:15062:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788744769.735502:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744769.735509:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744769.735512:0:15062:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788744769.735517:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788744769.735519:0:15062:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788744769.735521:0:15062:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788744769.735523:0:15062:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788744769.735524:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788744769.735527:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744769.735528:0:15062:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788744769.735531:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744769.735533:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744769.735535:0:15062:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788744769.735537:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788744769.735539:0:15062:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788744769.735542:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744769.735544:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744769.735545:0:15062:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788744769.735547:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744769.735549:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744769.735550:0:15062:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788744769.735553:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788744769.735615:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744769.735619:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744769.735627:0:15062:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788744769.735631:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788744769.735720:0:15047:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788744769.735762:0:15047:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788744769.735786:0:15047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e800/0x4b162761eb393073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39307a expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.735800:0:15047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23d17e800/0x4b162761eb393073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39307a expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744769.735809:0:15047:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a205178000 from 1 10000000:01000000:0.0:1788744769.735813:0:15047:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744769.735855:0:15047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb39308f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.735871:0:15047:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb39308f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.735884:0:15047:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb39308f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744769.735911:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475330304:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788744769.735996:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744769.736046:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a206784000 going to sleep for 11 seconds 00000100:00100000:2.0:1788744769.736312:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475330304 00000100:00100000:2.0:1788744769.736321:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475330304 00000100:00100000:2.0:1788744769.736366:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788744769.736377:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+14:15047:x1875634475330304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744769.736393:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744769.736408:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2064f3400/0x4b162761eb393096 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb39308f expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744769.736435:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2064f3400/0x4b162761eb393096 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb39308f expref: 15 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744769.736447:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2064f3400/0x4b162761eb393096 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb39308f expref: 15 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744769.736456:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3400, rc 0) 00000100:00100000:2.0:1788744769.736505:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+15:15047:x1875634475330304:12345-0@lo:101:mount.lustre.0 Request processed in 131us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744769.736512:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788744769.736548:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475330304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744769.736565:0:15047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb39308f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb393096 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.736575:0:15047:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb39308f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb393096 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788744769.737294:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788744769.737774:0:15047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744769.738026:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788744769.738069:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788744769.738166:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788744769.738174:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788744769.738237:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475330432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744769.738282:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744769.738320:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a206784000 going to sleep for 11 seconds 00000100:00100000:2.0:1788744769.738362:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475330432 00000100:00100000:2.0:1788744769.738370:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475330432 00000100:00100000:2.0:1788744769.738407:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788744769.738416:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+15:15047:x1875634475330432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744769.738612:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+15:15047:x1875634475330432:12345-0@lo:501:mount.lustre.0 Request processed in 196us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744769.738619:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788744769.742912:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475330432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744769.743006:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d355c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475330560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744769.743083:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744769.743152:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207fd6780 going to sleep for 11 seconds 00000100:00100000:2.0:1788744769.743723:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475330560 00000100:00100000:2.0:1788744769.743732:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475330560 00000100:00100000:2.0:1788744769.743793:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788744769.743803:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+15:15047:x1875634475330560:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744769.744019:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+15:15047:x1875634475330560:12345-0@lo:503:mount.lustre.0 Request processed in 217us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744769.744027:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788744769.744194:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d355c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475330560:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788744769.744915:0:15047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788744769.745023:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d355c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475330688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744769.745072:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744769.745110:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207fd6780 going to sleep for 11 seconds 00000100:00100000:2.0:1788744769.745355:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475330688 00000100:00100000:2.0:1788744769.745363:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475330688 00000100:00100000:2.0:1788744769.745394:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788744769.745402:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+15:15047:x1875634475330688:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744769.745577:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+15:15047:x1875634475330688:12345-0@lo:502:mount.lustre.0 Request processed in 175us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744769.745584:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788744769.746093:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d355c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475330688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788744769.746468:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788744769.746521:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788744769.746580:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788744769.746618:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788744769.746652:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788744769.746711:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788744769.746746:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788744769.746778:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788744769.746811:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d355c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475330816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744769.746860:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744769.746893:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207fd6780 going to sleep for 11 seconds 00000100:00100000:2.0:1788744769.746990:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475330816 00000100:00100000:2.0:1788744769.746997:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475330816 00000100:00100000:2.0:1788744769.747037:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788744769.747045:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+15:15047:x1875634475330816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744769.747229:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+15:15047:x1875634475330816:12345-0@lo:502:mount.lustre.0 Request processed in 184us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744769.747237:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788744769.747485:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d355c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475330816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788744769.747582:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788744769.747593:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788744769.749566:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744769.749577:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744769.749579:0:15066:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788744769.749586:0:15066:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93a205178000 00000020:00000080:2.0:1788744769.749589:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788744769.749595:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744769.749597:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744769.749598:0:15066:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788744769.749601:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744769.749611:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744769.749613:0:15066:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788744769.749616:0:15066:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93a205178000 00000020:00000080:2.0:1788744769.749618:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788744769.749671:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744769.749674:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744769.749676:0:15066:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788744769.749678:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744769.749680:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744769.749681:0:15066:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788744769.749685:0:15066:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93a205178000 00000020:00000080:2.0:1788744769.749687:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788744769.749718:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744769.749721:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744769.749722:0:15066:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788744769.749725:0:15066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788744769.749828:0:15047:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788744769.749853:0:15047:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788744769.749872:0:15047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb39308f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb393096 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744769.749884:0:15047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb39308f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb393096 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744769.749924:0:15047:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788744769.749927:0:15047:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93a205178000 10000000:01000000:3.0:1788744769.749940:0:15047:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93a205178000 10000000:01000000:3.0:1788744769.749958:0:15047:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744769.749964:0:15047:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93a205178000 from 1 10000000:01000000:3.0:1788744769.749967:0:15047:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788744769.750000:0:15047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80c00/0x4b162761eb39309d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744769.750008:0:15047:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a107e80c00/0x4b162761eb39309d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744769.750017:0:15047:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a107e80c00/0x4b162761eb39309d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744769.750038:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475330944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744769.750092:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744769.750157:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a206484300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744769.750301:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475330944 00000100:00100000:2.0:1788744769.750308:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475330944 00000100:00100000:2.0:1788744769.750354:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788744769.750363:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+15:15047:x1875634475330944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744769.750375:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744769.750388:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2064f3c00/0x4b162761eb3930a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb39309d expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744769.750412:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2064f3c00/0x4b162761eb3930a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb39309d expref: 16 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744769.750423:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2064f3c00/0x4b162761eb3930a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb39309d expref: 16 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744769.750432:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3c00, rc 0) 00000100:00100000:2.0:1788744769.750472:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+16:15047:x1875634475330944:12345-0@lo:101:mount.lustre.0 Request processed in 110us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744769.750484:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788744769.750531:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475330944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744769.750544:0:15047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a107e80c00/0x4b162761eb39309d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb3930a4 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744769.750553:0:15047:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a107e80c00/0x4b162761eb39309d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb3930a4 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744769.751178:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788744769.751595:0:15047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744769.751857:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788744769.751901:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788744769.755629:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788744769.755811:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788744769.755850:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788744769.755895:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788744769.755948:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788744769.759506:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788744769.759586:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788744769.759642:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788744769.759676:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788744769.759723:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788744769.759756:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788744769.759785:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788744769.759824:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788744769.759855:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788744769.759883:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788744769.759922:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788744769.759980:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788744769.760009:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788744769.760063:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788744769.760094:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788744769.760126:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788744769.763673:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788744769.763761:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788744769.763823:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788744769.763879:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788744769.763913:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788744769.766380:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788744769.766401:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788744769.766515:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475331072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744769.766580:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744769.766611:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744769.766729:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475331072 00000100:00100000:3.0:1788744769.766738:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475331072 00000100:00100000:3.0:1788744769.766788:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788744769.766797:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+16:15047:x1875634475331072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744769.767079:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+16:15047:x1875634475331072:12345-0@lo:501:mount.lustre.0 Request processed in 282us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744769.767088:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788744769.773239:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475331072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744769.773305:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475331200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744769.773385:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744769.773420:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744769.783852:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475331200 00000100:00100000:3.0:1788744769.783871:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475331200 00000100:00100000:3.0:1788744769.783989:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788744769.784002:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+16:15047:x1875634475331200:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744769.784664:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+16:15047:x1875634475331200:12345-0@lo:503:mount.lustre.0 Request processed in 663us (11277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744769.784683:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788744769.784833:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475331200:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788744769.785403:0:15047:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744769.785487:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475331328:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744769.785537:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744769.787605:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744769.787693:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475331328 00000100:00100000:1.0:1788744769.787702:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475331328 00000100:00100000:1.0:1788744769.787757:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788744769.787766:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+16:15047:x1875634475331328:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744769.788174:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+16:15047:x1875634475331328:12345-0@lo:502:mount.lustre.0 Request processed in 408us (2636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744769.788249:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788744769.790347:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475331328:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744769.790669:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788744769.790729:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788744769.790762:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788744769.790809:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788744769.790855:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788744769.790903:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788744769.790961:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788744769.790998:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788744769.791071:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788744769.791108:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788744769.791166:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788744769.791226:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788744769.791258:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788744769.791286:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788744769.791324:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788744769.791355:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788744769.791383:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788744769.791422:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788744769.791452:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788744769.791479:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788744769.791519:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788744769.791550:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788744769.791578:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788744769.791635:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788744769.791682:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788744769.791711:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788744769.791755:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788744769.791789:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788744769.791816:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788744769.791854:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788744769.791884:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788744769.791910:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788744769.791957:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788744769.792002:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788744769.792032:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788744769.792070:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788744769.792098:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788744769.792161:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788744769.792210:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788744769.792261:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788744769.792316:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475331456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744769.792389:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744769.792432:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207578e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744769.796374:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475331456 00000100:00100000:1.0:1788744769.796389:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475331456 00000100:00100000:1.0:1788744769.796449:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788744769.796461:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+16:15047:x1875634475331456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744769.796758:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+16:15047:x1875634475331456:12345-0@lo:502:mount.lustre.0 Request processed in 299us (4367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744769.796766:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788744769.802273:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475331456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744769.802447:0:15047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788744769.802462:0:15047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788744769.807771:0:15071:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788744769.807788:0:15071:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93a2064c0000) 00000020:00000080:0.0:1788744769.807816:0:15071:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788744769.807909:0:15071:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93a205178000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788744769.807914:0:15071:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93a205178000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788744769.807916:0:15071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93a205178000 3 00010000:00080000:0.0:1788744769.807973:0:15071:0:(ldlm_lib.c:103:import_set_conn()) imp ffff93a105518000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.106@tcp at head 00010000:00010000:0.0:1788744769.809546:0:15071:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788744769.809733:0:15071:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788744769.809767:0:15071:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788744769.809780:0:15071:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4b162761eb3930b2 00000100:00080000:0.0:1788744769.809790:0:15071:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788744769.809800:0:15071:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93a105518000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788744769.809835:0:15071:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23d43bb80 x1875634475331584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788744769.809872:0:15071:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788744769.813452:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744769.813462:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788744769.813465:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744769.813467:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788744769.813551:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875634475331584:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788744769.813628:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744769.813687:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744769.813694:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475331712:0@lo:400:kworker.0 00000100:00100000:3.0:1788744769.813719:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744769.813912:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475331584 00000100:00100000:3.0:1788744769.813919:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475331584 00000100:00100000:3.0:1788744769.814066:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475331712 00000100:00100000:3.0:1788744769.814070:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475331712 00000100:00100000:3.0:1788744769.814097:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744769.814104:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475331712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744769.814336:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475331712:12345-0@lo:400:kworker.0 Request processed in 231us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744769.814343:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744769.814361:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744769.814365:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1875634475331584:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788744769.814388:0:14367:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:3.0:1788744769.814468:0:14367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4b162761eb3930b9 00000004:00100000:3.0:1788744769.814494:0:14367:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788744769.814532:0:14367:0:(import.c:65:import_set_state_nolock()) ffff93a23b4e8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744769.814583:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875634475331584:12345-0@lo:38:llog_process_th.0 Request processed in 215us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744769.814590:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788744769.814629:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93a23c781c00 x1875634475331712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744769.814642:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475331712:0@lo:400:kworker.0 00010000:00080000:1.0:1788744769.814920:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93a23d43bb80 x1875634475331584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744769.814945:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788744769.814960:0:3306:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788744769.814971:0:3306:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788744769.814976:0:3306:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788744769.814979:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a105518000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788744769.814984:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875634475331584:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788744769.817354:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788744769.819422:0:15047:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788744769.819470:0:15047:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788744769.819488:0:15047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80c00/0x4b162761eb39309d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb3930a4 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744769.819501:0:15047:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a107e80c00/0x4b162761eb39309d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb3930a4 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788744769.819547:0:15047:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788744769.819549:0:15047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788744769.819551:0:15047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744769.819552:0:15047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744769.819553:0:15047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744769.819555:0:15047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744769.819557:0:15047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788744769.819558:0:15047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744769.819560:0:15047:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788744769.819564:0:15047:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788744769.819567:0:15047:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788744769.819568:0:15047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788744769.819569:0:15047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744769.819570:0:15047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744769.819571:0:15047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744769.819572:0:15047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744769.819573:0:15047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788744769.819574:0:15047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744769.819579:0:15047:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788744769.819607:0:15047:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788744769.819626:0:15047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475331840:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788744769.819694:0:15047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744769.819741:0:15047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a206484c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788744769.823018:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475331840 00000100:00100000:1.0:1788744769.823034:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475331840 00000100:00100000:1.0:1788744769.823113:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788744769.823124:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+16:15047:x1875634475331840:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788744769.823187:0:14359:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788744769.823205:0:14359:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788744769.858359:0:14359:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788744769.858373:0:14359:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788744769.858787:0:14382:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788744769.858792:0:14382:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788744769.858815:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3930c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.858835:0:14382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a107e80400/0x4b162761eb39302d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb393026 expref: 16 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.858845:0:14382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3930c0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.858895:0:14382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a107e80400/0x4b162761eb39302d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb393026 expref: 16 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.858909:0:14382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93a107e80400/0x4b162761eb39302d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb393026 expref: 16 pid: 14359 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744769.858966:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14382:1875634475331968:0@lo:104: 00000100:00100000:0.0:1788744769.859029:0:14382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744769.859075:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788744769.859285:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475331968 00000100:00100000:2.0:1788744769.859293:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475331968 00000100:00100000:2.0:1788744769.859335:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744769.859345:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85c0995c-9591-4016-879e-a5185771e142+3:14382:x1875634475331968:12345-0@lo:104: 00010000:00010000:2.0:1788744769.859358:0:14350:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb393026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb39302d expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744769.859409:0:14350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744769.859414:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85c0995c-9591-4016-879e-a5185771e142+3:14382:x1875634475331968:12345-0@lo:104: Request processed in 72us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744769.859420:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788744769.859444:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744769.859450:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb393026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb39302d expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744769.859457:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f400 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:2.0:1788744769.859461:0:14355:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb393026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb39302d expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744769.859469:0:14355:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb393026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb39302d expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744769.859482:0:14355:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb393026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb39302d expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744769.859488:0:14355:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788744769.859512:0:14355:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb393026 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb39302d expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744769.859517:0:14355:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744769.859533:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb393026 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb39302d expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744769.859539:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a23d17f400/0x4b162761eb393026 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb39302d expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744769.859556:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744769.859558:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744769.859559:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744769.859651:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85c0995c-9591-4016-879e-a5185771e142:3309:1875634475332096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744769.859685:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744769.859728:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475332096 00000100:00100000:1.0:1788744769.859732:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475332096 00010000:00010000:1.0:1788744769.859752:0:14351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a107e80400/0x4b162761eb39302d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb393026 expref: 17 pid: 14359 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744769.859771:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744769.859777:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d355c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85c0995c-9591-4016-879e-a5185771e142+17:3309:x1875634475332096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744769.859786:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744769.859791:0:14351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a107e80400/0x4b162761eb39302d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb393026 expref: 17 pid: 14359 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744769.859800:0:14351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a107e80400/0x4b162761eb39302d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb393026 expref: 17 pid: 14359 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744769.859815:0:14351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3930c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744769.859823:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3930c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788744769.859836:0:14351:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001364653s 00010000:00010000:1.0:1788744769.859841:0:14351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3930c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744769.859848:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3930c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744769.859854:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3930c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744769.859869:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3930c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744769.859875:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17fc00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744769.859878:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3930c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744769.859885:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3930c0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744769.859893:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3930c0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744769.859903:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744769.859948:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d355c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85c0995c-9591-4016-879e-a5185771e142+17:3309:x1875634475332096:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744769.859955:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744769.859994:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85c0995c-9591-4016-879e-a5185771e142:3309:1875634475332096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744769.860794:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a107e80400/0x4b162761eb39302d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb393026 expref: 16 pid: 14359 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744769.860812:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14382:1875634475331968:0@lo:104: 00010000:00010000:0.0:1788744769.860830:0:14382:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3930c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.860839:0:14382:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3930c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.860846:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3930c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744769.860852:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3930c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744769.872575:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+15:15047:x1875634475331840:12345-0@lo:253:mount.lustre.0 Request processed in 49442us (52869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744769.872592:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788744769.872728:0:15047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15047:1875634475331840:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788744769.872745:0:15047:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788744769.872748:0:15047:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788744769.872750:0:15047:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788744769.872751:0:15047:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744769.872753:0:15047:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744769.872754:0:15047:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744769.872756:0:15047:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744769.872757:0:15047:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788744769.872759:0:15047:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744769.872760:0:15047:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788744769.872788:0:15047:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788744769.883771:0:15047:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788744769.883946:0:15047:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788744769.884106:0:15047:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788744769.884354:0:15047:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788744769.884484:0:15047:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788744769.884681:0:15047:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788744769.892727:0:15047:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788744769.986001:0:15047:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788744769.986013:0:15047:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788744769.986060:0:15047:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788744769.986166:0:15047:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788744769.986205:0:15047:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788744769.986234:0:15047:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788744770.679109:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744771.700415:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788744771.700472:0:14363:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788744771.700477:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93a23bd31800 from 7 10000000:01000000:2.0:1788744771.700488:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788744771.700528:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2064f2400/0x4b162761eb3930c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744771.700540:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a2064f2400/0x4b162761eb3930c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744771.700552:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a2064f2400/0x4b162761eb3930c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744771.700574:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475332224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744771.700647:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744771.700696:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220a6b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788744771.700740:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475332224 00000100:00100000:1.0:1788744771.700748:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475332224 00000100:00100000:1.0:1788744771.700787:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788744771.700795:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+15:14363:x1875634475332224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744771.700807:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744771.700818:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a23051b600/0x4b162761eb3930ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb3930c7 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744771.700839:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23051b600/0x4b162761eb3930ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb3930c7 expref: 16 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744771.700849:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a23051b600/0x4b162761eb3930ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb3930c7 expref: 16 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744771.700857:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051b600, rc 0) 00000100:00100000:1.0:1788744771.700908:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+16:14363:x1875634475332224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744771.700914:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788744771.701057:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475332224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744771.701070:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a2064f2400/0x4b162761eb3930c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb3930ce expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744771.701079:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a2064f2400/0x4b162761eb3930c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb3930ce expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744771.701119:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475332352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788744771.701290:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744771.701314:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220a6b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744771.701362:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475332352 00000100:00100000:3.0:1788744771.701368:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475332352 00000100:00100000:3.0:1788744771.701395:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788744771.701401:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+16:14363:x1875634475332352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788744771.701414:0:14359:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788744771.701430:0:14359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788744771.701433:0:14359:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788744771.701509:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+16:14363:x1875634475332352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744771.701516:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788744771.702622:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475332352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788744771.702695:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788744771.702704:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2064f2400/0x4b162761eb3930c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb3930ce expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744771.702715:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a2064f2400/0x4b162761eb3930c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb3930ce expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744772.736638:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744773.748686:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744774.773287:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788744774.970672:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744774.970678:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788744774.970681:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744774.970684:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788744774.972026:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744774.972068:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85c0995c-9591-4016-879e-a5185771e142:3309:1875634475332480:0@lo:400:kworker.0 00000100:00100000:1.0:1788744774.973016:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744774.973311:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475332608:0@lo:400:kworker.0 00000100:00100000:3.0:1788744774.973355:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744774.973364:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475332480 00000100:00100000:1.0:1788744774.973374:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475332480 00000100:00100000:1.0:1788744774.973421:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788744774.973431:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+16:3309:x1875634475332480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744774.973477:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+16:3309:x1875634475332480:12345-0@lo:400:kworker.0 Request processed in 48us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744774.973493:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788744774.973593:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85c0995c-9591-4016-879e-a5185771e142:3309:1875634475332480:0@lo:400:kworker.0 00000100:00100000:3.0:1788744774.974535:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744774.974544:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475332736:0@lo:400:kworker.0 00000100:00100000:3.0:1788744774.974577:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744774.974609:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475332608 00000100:00100000:3.0:1788744774.974614:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475332608 00000100:00100000:3.0:1788744774.974646:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475332736 00000100:00100000:3.0:1788744774.974649:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475332736 00000100:00100000:3.0:1788744774.974670:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744774.974676:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475332608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744774.974725:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475332608:12345-0@lo:400:kworker.0 Request processed in 49us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744774.974732:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744774.974744:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744774.974750:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475332736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744774.974773:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475332736:12345-0@lo:400:kworker.0 Request processed in 24us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744774.974779:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788744774.974812:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23c783480 x1875634475332736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744774.974824:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475332736:0@lo:400:kworker.0 00010000:00080000:3.0:1788744774.974833:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23c783100 x1875634475332608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744774.974859:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475332608:0@lo:400:kworker.0 00000100:00080000:3.0:1788744774.974906:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788744775.882283:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744776.891481:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788744777.206728:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788744777.897762:0:15415:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788744777.927112:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744778.933451:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744779.957404:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744780.090787:0:3306:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744765/real 1788744765] req@ffff93a23c782a00 x1875634475328896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744780 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744780.090816:0:3306:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93a23c782a00 x1875634475328896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744780 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744780.090826:0:3306:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744765/real 1788744765] req@ffff93a23c781f80 x1875634475329024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744780 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744780.090839:0:3306:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93a23c781f80 x1875634475329024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744780 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788744780.090857:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a241d5a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1788744780.090980:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85c0995c-9591-4016-879e-a5185771e142:3309:1875634475332864:0@lo:400:kworker.0 00000100:00100000:1.0:1788744780.091054:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788744780.098068:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788744780.098080:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788744780.098084:0:38:0:(import.c:65:import_set_state_nolock()) ffff93a241d5a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744780.098092:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:0.0:1788744780.098098:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788744780.098112:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93a241d5a000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788744780.098173:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23d43ad80 x1875634475332992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788744780.098189:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788744780.098192:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788744780.098322:0:3306:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788744780.098330:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475328896:0@lo:8:kworker.0 00000100:00080000:3.0:1788744780.098338:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a204f17000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744780.098345:0:3306:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788744780.098348:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475329024:0@lo:8:kworker.0 00000100:00100000:3.0:1788744780.098387:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475332992:0@lo:8:kworker.0 00000100:00100000:3.0:1788744780.098460:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744780.098543:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475332992 00000100:00100000:3.0:1788744780.098550:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475332992 00000100:00100000:3.0:1788744780.098589:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744780.098596:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875634475332992:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788744780.098622:0:15049:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:3.0:1788744780.098663:0:15049:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b162761eb3930d5 00002000:00100000:3.0:1788744780.098677:0:15049:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93a23b4ee000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788744780.098682:0:15049:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788744780.098686:0:15049:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788744780.099026:0:15049:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788744780.099208:0:15049:0:(import.c:65:import_set_state_nolock()) ffff93a23b4ea800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744780.099272:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875634475332992:12345-0@lo:8:kworker.0 Request processed in 675us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744780.099281:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788744780.099323:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23d43ad80 x1875634475332992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788744800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744780.099334:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788744780.099340:0:3306:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788744780.099346:0:3306:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788744780.099351:0:3306:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788744780.099353:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a241d5a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788744780.099368:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788744780.099373:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475332992:0@lo:8:kworker.0 00000004:00080000:3.0:1788744780.099414:0:14389:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1788744780.099430:0:14389:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14389:1875634475333376:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788744780.099454:0:14389:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744780.099472:0:14389:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23ccd6780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744780.099485:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475333248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744780.099508:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744780.099776:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475333376 00000100:00100000:1.0:1788744780.099782:0:15050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475333376 00000100:00100000:1.0:1788744780.099816:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744780.099825:0:15050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14389:x1875634475333376:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788744780.102276:0:15050:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788744780.102286:0:15050:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788744780.102292:0:15050:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00080000:3.0:1788744780.103216:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744780.106248:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788744780.106257:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788744780.106261:0:38:0:(import.c:65:import_set_state_nolock()) ffff93a204f17000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744780.106273:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:0.0:1788744780.106281:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788744780.106296:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93a204f17000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788744780.106326:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23d43b480 x1875634475333632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744780.106373:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634475333120:0@lo:400:kworker.0 00000100:00100000:0.0:1788744780.106454:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744780.106649:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875634475333504:0@lo:400:kworker.0 00000100:00100000:3.0:1788744780.106687:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744780.106728:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475333632:0@lo:8:kworker.0 00000100:00100000:3.0:1788744780.106771:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744780.106814:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475333120 00000100:00100000:3.0:1788744780.106823:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475333120 00000100:00100000:3.0:1788744780.106862:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475333504 00000100:00100000:3.0:1788744780.106865:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475333504 00000100:00100000:3.0:1788744780.106892:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744780.106899:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634475333120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744780.106950:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634475333120:12345-0@lo:400:kworker.0 Request processed in 51us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744780.106958:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744780.106978:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744780.106983:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875634475333504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744780.107012:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875634475333504:12345-0@lo:400:kworker.0 Request processed in 29us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744780.107017:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744780.107046:0:15049:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788744780.107054:0:15049:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:3.0:1788744780.107071:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788744780.107098:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23d43b800 x1875634475333504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744780.107111:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875634475333504:0@lo:400:kworker.0 00010000:00080000:3.0:1788744780.107256:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23d438a80 x1875634475333120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744780.107266:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634475333120:0@lo:400:kworker.0 00000004:00080000:0.0:1788744780.107430:0:14388:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788744780.107959:0:14388:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 482806827982ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788744780.107988:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475332864 00000100:00100000:0.0:1788744780.107994:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475332864 00000100:00100000:0.0:1788744780.108024:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788744780.108883:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+16:3309:x1875634475332864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744780.108954:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+16:3309:x1875634475332864:12345-0@lo:400:kworker.0 Request processed in 922us (17899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744780.108963:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788744780.109011:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85c0995c-9591-4016-879e-a5185771e142:3309:1875634475332864:0@lo:400:kworker.0 00000100:00100000:3.0:1788744780.110645:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475333632 00000100:00100000:3.0:1788744780.110656:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475333632 00000100:00100000:2.0:1788744780.110835:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744780.110843:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3306:x1875634475333632:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788744780.110863:0:15495:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788744780.110967:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3306:x1875634475333632:12345-0@lo:8:kworker.0 Request processed in 123us (4194us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788744780.110974:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788744780.118947:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a204f17000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744780.118961:0:3306:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788744780.118967:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475333632:0@lo:8:kworker.0 00002000:00010000:1.0:1788744780.128659:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.128672:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000385d52ce/0x4b162761eb3930dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.128689:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.128693:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.128699:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000385d52ce/0x4b162761eb3930dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.128720:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000385d52ce/0x4b162761eb3930dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.128731:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000385d52ce/0x4b162761eb3930dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.128746:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000385d52ce/0x4b162761eb3930dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.128780:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744780.128815:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744780.128824:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000385d52ce/0x4b162761eb3930dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.128834:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b800 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744780.128838:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000385d52ce/0x4b162761eb3930dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.128849:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000385d52ce/0x4b162761eb3930dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.128870:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000385d52ce/0x4b162761eb3930dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.128878:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000385d52ce/0x4b162761eb3930dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.128900:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.128902:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.128904:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744780.129257:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475333248 00000100:00100000:0.0:1788744780.129267:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475333248 00000100:00100000:0.0:1788744780.129322:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744780.129332:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875634475333248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744780.129365:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744780.129452:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875634475333248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (29943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744780.129459:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744780.129565:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475333248:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1788744780.135532:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.135557:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000549efdea/0x4b162761eb3930e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.135574:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.135579:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.135585:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000549efdea/0x4b162761eb3930e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.135599:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000549efdea/0x4b162761eb3930e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.135617:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000549efdea/0x4b162761eb3930e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.135625:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000549efdea/0x4b162761eb3930e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.135644:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788744780.136223:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.136230:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb3930ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.136247:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.136250:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.136254:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb3930ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.136266:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb3930ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.136275:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb3930ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.136283:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb3930ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.136302:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788744780.136712:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744780.136721:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000549efdea/0x4b162761eb3930e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744780.136730:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a400 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744780.136734:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000549efdea/0x4b162761eb3930e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744780.136947:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000549efdea/0x4b162761eb3930e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744780.136970:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000549efdea/0x4b162761eb3930e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744780.136977:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000549efdea/0x4b162761eb3930e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744780.136997:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744780.137002:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb3930ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744780.137008:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051ba00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744780.137011:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb3930ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744780.137018:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb3930ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744780.137028:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb3930ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744780.137611:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95a20bf/0x4b162761eb3930ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744780.137637:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744780.137640:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744780.137641:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744780.146218:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.146233:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3efdbe4/0x4b162761eb3930f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.146249:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.146254:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.146260:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3efdbe4/0x4b162761eb3930f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.146275:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3efdbe4/0x4b162761eb3930f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.146299:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3efdbe4/0x4b162761eb3930f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.146307:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3efdbe4/0x4b162761eb3930f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.146332:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788744780.148726:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.148737:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb1cccc3/0x4b162761eb3930f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.149183:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.149189:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.149195:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb1cccc3/0x4b162761eb3930f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.149210:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb1cccc3/0x4b162761eb3930f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.149222:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb1cccc3/0x4b162761eb3930f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.149231:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb1cccc3/0x4b162761eb3930f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.149255:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788744780.151834:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.151847:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb3930ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.151862:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.151866:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.151872:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb3930ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.151886:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb3930ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.151896:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb3930ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.151904:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb3930ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.151915:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788744780.155782:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.155797:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dde97f5/0x4b162761eb393106 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.155815:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.155829:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.155836:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dde97f5/0x4b162761eb393106 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.155851:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dde97f5/0x4b162761eb393106 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.155861:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dde97f5/0x4b162761eb393106 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.155869:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dde97f5/0x4b162761eb393106 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.155880:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788744780.160170:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.160187:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb39310d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.160208:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.160214:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.160222:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb39310d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.160237:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb39310d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.160248:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb39310d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.160266:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb39310d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.160278:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788744780.160725:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.160732:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046e60949/0x4b162761eb393114 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.160741:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.160744:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.160766:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046e60949/0x4b162761eb393114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.160778:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046e60949/0x4b162761eb393114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.160787:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046e60949/0x4b162761eb393114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.160795:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046e60949/0x4b162761eb393114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.160803:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788744780.161206:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.161212:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb104332/0x4b162761eb39311b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.161227:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.161230:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.161235:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb104332/0x4b162761eb39311b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.161245:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb104332/0x4b162761eb39311b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.161252:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb104332/0x4b162761eb39311b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.161259:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb104332/0x4b162761eb39311b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.161267:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1788744780.161656:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.161662:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027442484/0x4b162761eb393122 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.161671:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.161674:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.161678:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027442484/0x4b162761eb393122 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.161688:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027442484/0x4b162761eb393122 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.161709:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027442484/0x4b162761eb393122 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.161716:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027442484/0x4b162761eb393122 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.161724:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1788744780.162123:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.162176:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b7adcd2/0x4b162761eb393129 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162187:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.162191:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.162194:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b7adcd2/0x4b162761eb393129 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162204:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b7adcd2/0x4b162761eb393129 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162212:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b7adcd2/0x4b162761eb393129 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162219:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b7adcd2/0x4b162761eb393129 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162254:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788744780.162261:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3efdbe4/0x4b162761eb3930f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162269:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051be00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744780.162274:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3efdbe4/0x4b162761eb3930f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162283:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3efdbe4/0x4b162761eb3930f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162301:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3efdbe4/0x4b162761eb3930f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162309:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3efdbe4/0x4b162761eb3930f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162331:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788744780.162335:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb1cccc3/0x4b162761eb3930f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162340:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a000 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744780.162344:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb1cccc3/0x4b162761eb3930f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162362:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb1cccc3/0x4b162761eb3930f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162374:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb1cccc3/0x4b162761eb3930f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162381:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb1cccc3/0x4b162761eb3930f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162394:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788744780.162398:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb3930ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162404:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b000 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744780.162407:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb3930ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162414:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb3930ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162423:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb3930ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162431:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb3930ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162452:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788744780.162457:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dde97f5/0x4b162761eb393106 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162464:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051ae00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744780.162468:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dde97f5/0x4b162761eb393106 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162477:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dde97f5/0x4b162761eb393106 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162487:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dde97f5/0x4b162761eb393106 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162493:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dde97f5/0x4b162761eb393106 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162504:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788744780.162507:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb39310d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162513:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051bc00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744780.162516:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb39310d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162533:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb39310d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162543:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb39310d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162550:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb39310d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162562:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788744780.162566:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046e60949/0x4b162761eb393114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162572:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b200 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744780.162575:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046e60949/0x4b162761eb393114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162583:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046e60949/0x4b162761eb393114 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162591:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046e60949/0x4b162761eb393114 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162597:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046e60949/0x4b162761eb393114 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162621:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744780.162625:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb104332/0x4b162761eb39311b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162631:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a800 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744780.162634:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb104332/0x4b162761eb39311b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162641:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb104332/0x4b162761eb39311b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162651:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb104332/0x4b162761eb39311b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162657:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb104332/0x4b162761eb39311b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162667:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744780.162670:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027442484/0x4b162761eb393122 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162676:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b400 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744780.162679:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027442484/0x4b162761eb393122 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162697:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027442484/0x4b162761eb393122 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162708:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027442484/0x4b162761eb393122 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162715:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027442484/0x4b162761eb393122 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.162728:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.162730:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.162732:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.168760:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.168787:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744780.168807:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744780.168815:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b7adcd2/0x4b162761eb393129 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.168828:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051ac00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744780.168833:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b7adcd2/0x4b162761eb393129 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.168845:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b7adcd2/0x4b162761eb393129 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.168865:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b7adcd2/0x4b162761eb393129 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.168884:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b7adcd2/0x4b162761eb393129 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.168905:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.168907:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.168908:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744780.171800:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.171810:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393130 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.171825:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.171829:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.171835:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393130 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.171849:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393130 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.171859:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393130 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.171867:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393130 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.171898:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744780.172187:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744780.172197:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393130 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.172207:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e7a00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744780.172212:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393130 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.172221:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393130 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.172240:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393130 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.172247:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393130 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.172267:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.172269:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.172271:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744780.173047:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.173060:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb393137 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.173072:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.173076:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.173080:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb393137 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.173091:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb393137 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.173662:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb393137 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.173670:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb393137 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.173694:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744780.173709:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744780.173714:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb393137 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.173721:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e6400 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744780.173725:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb393137 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.173733:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb393137 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.173783:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb393137 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.173791:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb393137 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.173809:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.173811:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.173813:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744780.175234:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.175244:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000479cad26/0x4b162761eb39313e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.175258:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.175262:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.175268:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000479cad26/0x4b162761eb39313e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.175280:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000479cad26/0x4b162761eb39313e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.175290:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000479cad26/0x4b162761eb39313e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.175297:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000479cad26/0x4b162761eb39313e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.175338:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744780.175366:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744780.175374:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000479cad26/0x4b162761eb39313e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.175385:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e6c00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744780.175389:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000479cad26/0x4b162761eb39313e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.175410:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000479cad26/0x4b162761eb39313e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.175427:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000479cad26/0x4b162761eb39313e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.175444:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000479cad26/0x4b162761eb39313e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.175463:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.175466:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.175467:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744780.177863:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.177876:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393145 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.177892:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.177896:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.177902:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393145 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.177917:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393145 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.177928:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393145 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.178490:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393145 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.178510:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744780.178525:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744780.178531:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393145 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.178539:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e7800 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744780.178698:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393145 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.178709:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393145 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.178728:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393145 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.178735:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393145 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.178764:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.178766:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.178768:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744780.187665:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.187681:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb39314c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.187697:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.187701:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.187707:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb39314c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.187722:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb39314c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.187732:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb39314c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.187761:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb39314c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.187784:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744780.187797:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744780.187803:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb39314c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.187811:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e6400 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744780.187816:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb39314c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.187826:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb39314c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.187845:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb39314c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.187852:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b807821e/0x4b162761eb39314c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.187872:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.187874:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.187876:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744780.189299:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.189316:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddbb9eac/0x4b162761eb393153 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.189330:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.189335:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.189340:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbb9eac/0x4b162761eb393153 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.189353:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddbb9eac/0x4b162761eb393153 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.189362:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddbb9eac/0x4b162761eb393153 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.189370:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbb9eac/0x4b162761eb393153 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.189391:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744780.189415:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744780.189420:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddbb9eac/0x4b162761eb393153 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.189427:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e7400 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744780.189431:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddbb9eac/0x4b162761eb393153 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.189440:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddbb9eac/0x4b162761eb393153 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.189461:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddbb9eac/0x4b162761eb393153 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.189468:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddbb9eac/0x4b162761eb393153 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.189485:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.189487:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.189489:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744780.190486:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.190495:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cdfce46/0x4b162761eb39315a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.190506:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.190510:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.190515:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cdfce46/0x4b162761eb39315a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.190526:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cdfce46/0x4b162761eb39315a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.190535:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cdfce46/0x4b162761eb39315a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.190885:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cdfce46/0x4b162761eb39315a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.190932:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744780.191190:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744780.191195:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cdfce46/0x4b162761eb39315a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.191203:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e7200 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744780.191208:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cdfce46/0x4b162761eb39315a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.191217:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cdfce46/0x4b162761eb39315a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.191232:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cdfce46/0x4b162761eb39315a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.191239:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cdfce46/0x4b162761eb39315a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.191255:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.191257:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.191259:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744780.193727:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.193741:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393161 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.193768:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.193779:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.193785:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393161 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.193800:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393161 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.193811:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393161 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.193819:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393161 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.193849:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744780.194232:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744780.194241:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393161 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.194250:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e7800 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744780.194255:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393161 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.194266:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393161 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.194284:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393161 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.194307:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000764ba45e/0x4b162761eb393161 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.194327:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.194329:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.194331:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744780.194341:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.194348:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb393168 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.194357:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.194360:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.194365:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb393168 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.194375:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb393168 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.194383:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb393168 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.194396:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb393168 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.194420:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744780.195264:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744780.195271:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb393168 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.195281:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e6000 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744780.195286:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb393168 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.195294:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb393168 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.195309:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb393168 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.195318:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f49e11b/0x4b162761eb393168 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.195336:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.195337:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.195339:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744780.195431:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.195438:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb39316f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.195448:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.195452:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.195456:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb39316f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.195468:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb39316f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.195476:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb39316f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.195484:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb39316f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.195507:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788744780.196814:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.196823:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393176 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.196844:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.196848:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.196853:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393176 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.196865:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393176 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.196874:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393176 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.196882:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393176 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.196903:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788744780.196914:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744780.196920:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb39316f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.196928:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e7e00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744780.196993:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb39316f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.197004:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb39316f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.197035:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb39316f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.197041:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005707728c/0x4b162761eb39316f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.197144:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744780.197462:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.197464:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.197467:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744780.198016:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.198024:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000426e40dd/0x4b162761eb39317d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.198036:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.198040:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.198045:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000426e40dd/0x4b162761eb39317d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.198066:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000426e40dd/0x4b162761eb39317d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.198076:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000426e40dd/0x4b162761eb39317d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.198083:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000426e40dd/0x4b162761eb39317d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.198147:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744780.198211:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744780.198219:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000426e40dd/0x4b162761eb39317d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.198228:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a210599e00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744780.198231:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000426e40dd/0x4b162761eb39317d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.198241:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000426e40dd/0x4b162761eb39317d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.198255:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000426e40dd/0x4b162761eb39317d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.198262:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000426e40dd/0x4b162761eb39317d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.198279:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.198281:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.198283:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744780.198573:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.198578:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076c05d57/0x4b162761eb393184 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.198587:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.198591:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.198595:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076c05d57/0x4b162761eb393184 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.198605:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076c05d57/0x4b162761eb393184 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.198613:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076c05d57/0x4b162761eb393184 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.198620:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076c05d57/0x4b162761eb393184 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.198638:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744780.198647:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744780.198652:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076c05d57/0x4b162761eb393184 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.198660:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a210599200 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744780.198670:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076c05d57/0x4b162761eb393184 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.198678:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076c05d57/0x4b162761eb393184 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.198691:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076c05d57/0x4b162761eb393184 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.198698:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076c05d57/0x4b162761eb393184 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.198712:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.198714:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.198716:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744780.198872:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744780.198881:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393176 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744780.198888:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2027e7a00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744780.198892:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393176 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744780.198900:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393176 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744780.198914:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393176 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744780.198921:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023cba631/0x4b162761eb393176 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744780.198941:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744780.198944:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744780.198946:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744780.198950:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744780.198952:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744780.199186:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.199193:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020c9d828/0x4b162761eb39318b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.199201:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.199204:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.199209:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020c9d828/0x4b162761eb39318b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.199218:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020c9d828/0x4b162761eb39318b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.199225:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020c9d828/0x4b162761eb39318b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.199239:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020c9d828/0x4b162761eb39318b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.199260:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744780.199596:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744780.199601:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020c9d828/0x4b162761eb39318b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.199610:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a210598400 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744780.199614:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020c9d828/0x4b162761eb39318b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.199635:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020c9d828/0x4b162761eb39318b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.199649:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020c9d828/0x4b162761eb39318b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.199657:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020c9d828/0x4b162761eb39318b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.199674:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744780.199675:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744780.199676:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.199680:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744780.199684:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfdb04b5/0x4b162761eb393192 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.199694:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.199697:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.199700:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfdb04b5/0x4b162761eb393192 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.199709:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfdb04b5/0x4b162761eb393192 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.199717:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfdb04b5/0x4b162761eb393192 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.199726:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfdb04b5/0x4b162761eb393192 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.200856:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744780.202790:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744780.202802:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfdb04b5/0x4b162761eb393192 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.202815:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a210598a00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744780.202819:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfdb04b5/0x4b162761eb393192 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.202831:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfdb04b5/0x4b162761eb393192 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.202852:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfdb04b5/0x4b162761eb393192 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.202874:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfdb04b5/0x4b162761eb393192 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.202894:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.202896:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.202898:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744780.203438:0:15050:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744780.203446:0:15050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037b8dc0f/0x4b162761eb393199 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.203465:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788744780.203470:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744780.203476:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037b8dc0f/0x4b162761eb393199 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.203489:0:15050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037b8dc0f/0x4b162761eb393199 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.203498:0:15050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037b8dc0f/0x4b162761eb393199 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.203507:0:15050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037b8dc0f/0x4b162761eb393199 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744780.203537:0:15050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744780.203621:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744780.203628:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037b8dc0f/0x4b162761eb393199 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.203637:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a210599000 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744780.203641:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037b8dc0f/0x4b162761eb393199 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.203650:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037b8dc0f/0x4b162761eb393199 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.203663:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037b8dc0f/0x4b162761eb393199 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.203670:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037b8dc0f/0x4b162761eb393199 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744780.203687:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.203689:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744780.203691:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788744780.203813:0:15050:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1788744780.204599:0:14389:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14389:1875634475333376:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788744780.204619:0:14389:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1788744780.204671:0:14389:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14389:1875634475333760:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788744780.204717:0:14389:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744780.204774:0:14389:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23ccd6780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744780.204795:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475333760 00000100:00100000:3.0:1788744780.204800:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475333760 00000100:00100000:3.0:1788744780.204846:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744780.204855:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14389:x1875634475333760:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788744780.204899:0:15049:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1788744780.205570:0:15050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14389:x1875634475333376:12345-0@lo:5:osp-pre-0-0.0 Request processed in 104110us (104479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744780.205580:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744780.224186:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14389:x1875634475333760:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19325us (19462us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788744780.224199:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744780.224258:0:14389:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c783100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14389:1875634475333760:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788744780.224274:0:14389:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:0.0:1788744780.286778:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788744780.981339:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744782.004726:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744783.035314:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744784.052473:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744785.077397:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788744785.205285:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744785.205292:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788744785.205296:0:38:0:(import.c:65:import_set_state_nolock()) ffff93a204f17000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744785.205306:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:1.0:1788744785.205312:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788744785.205324:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93a204f17000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1788744785.205358:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23d357800 x1875634475334144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788744785.205800:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475334016:0@lo:400:kworker.0 00000100:00100000:0.0:1788744785.207503:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85c0995c-9591-4016-879e-a5185771e142:3309:1875634475333888:0@lo:400:kworker.0 00000100:00100000:1.0:1788744785.214296:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875634475334400:0@lo:400:kworker.0 00000100:00100000:0.0:1788744785.214529:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744785.214575:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475333888 00000100:00100000:0.0:1788744785.214582:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475333888 00000100:00100000:0.0:1788744785.214643:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788744785.214653:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+16:3309:x1875634475333888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744785.214718:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+16:3309:x1875634475333888:12345-0@lo:400:kworker.0 Request processed in 65us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744785.214724:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788744785.214792:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85c0995c-9591-4016-879e-a5185771e142:3309:1875634475333888:0@lo:400:kworker.0 00000100:00100000:0.0:1788744785.214802:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475334528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744785.214829:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744785.214853:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475334528 00000100:00100000:0.0:1788744785.214857:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475334528 00000100:00100000:0.0:1788744785.214897:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744785.214903:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875634475334528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744785.214940:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744785.214973:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875634475334528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744785.214980:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788744785.215012:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744785.215045:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475334528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744785.218053:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744785.218535:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475334016 00000100:00100000:0.0:1788744785.218547:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475334016 00000100:00100000:0.0:1788744785.218612:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744785.218622:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1875634475334016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744785.218719:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1875634475334016:12345-0@lo:400:kworker.0 Request processed in 99us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744785.218727:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744785.218783:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475334016:0@lo:400:kworker.0 00000100:00100000:1.0:1788744785.219065:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475334272:0@lo:400:kworker.0 00000100:00100000:1.0:1788744785.219102:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744785.219197:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475334144:0@lo:8:kworker.0 00000100:00100000:0.0:1788744785.219231:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744785.219440:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744785.219941:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475334144 00000100:00100000:2.0:1788744785.219949:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475334144 00000100:00100000:2.0:1788744785.219995:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744785.220017:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3306:x1875634475334144:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788744785.220039:0:15495:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788744785.231762:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475334272 00000100:00100000:3.0:1788744785.231783:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475334272 00000100:00100000:3.0:1788744785.231884:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475334400 00000100:00100000:3.0:1788744785.231888:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475334400 00000100:00100000:3.0:1788744785.231935:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788744785.231946:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475334272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744785.232076:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475334272:12345-0@lo:400:kworker.0 Request processed in 131us (12972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744785.232099:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744785.232301:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744785.232311:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875634475334400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744785.232354:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875634475334400:12345-0@lo:400:kworker.0 Request processed in 45us (12915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744785.232361:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788744785.232413:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23d354a80 x1875634475334272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744785.232428:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475334272:0@lo:400:kworker.0 00010000:00080000:1.0:1788744785.232462:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23d355180 x1875634475334400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744785.232473:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875634475334400:0@lo:400:kworker.0 00000100:00080000:0.0:1788744785.241306:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744785.245583:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a204f17000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788744785.245598:0:3306:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788744785.245604:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475334144:0@lo:8:kworker.0 00000100:00100000:2.0:1788744785.253391:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3306:x1875634475334144:12345-0@lo:8:kworker.0 Request processed in 33361us (34144us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788744785.253474:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000001:00080000:2.0:1788744785.342710:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788744785.342729:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788744786.100385:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788744786.777796:0:15768:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788744786.777800:0:15768:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788744786.777963:0:15768:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93a20653f800 00000020:01000004:3.0:1788744786.777982:0:15768:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788744786.777997:0:15768:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788744786.778025:0:15768:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93a210548000) 00000020:00000080:3.0:1788744786.778041:0:15768:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788744786.805717:0:15768:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788744786.806568:0:15768:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788744786.807743:0:15768:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788744786.808510:0:15768:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788744786.808760:0:15768:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788744786.809590:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 763: rc = 0 00100000:10000000:2.0:1788744786.809713:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 763: rc = 0 00100000:10000000:2.0:1788744786.809988:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 763: rc = 0 00100000:10000000:2.0:1788744786.810995:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 396: rc = 0 00100000:10000000:2.0:1788744786.811509:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 396: rc = 0 00100000:10000000:2.0:1788744786.811754:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 396: rc = 0 00100000:10000000:3.0:1788744786.812569:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 396: rc = 0 00100000:10000000:3.0:1788744786.812800:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 396: rc = 0 00100000:10000000:3.0:1788744786.813415:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 396: rc = 0 00000020:00000080:3.0:1788744786.814556:0:15768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788744786.814571:0:15768:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788744786.814584:0:15768:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b162761eb3931a7 00000020:01000004:3.0:1788744786.814592:0:15768:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788744786.814615:0:15768:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788744786.814619:0:15768:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788744786.814625:0:15768:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788744786.814654:0:15768:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788744786.814658:0:15768:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788744786.828535:0:15768:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788744786.828581:0:15768:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.106@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788744786.828585:0:15768:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788744786.828588:0:15768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788744786.828589:0:15768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744786.828590:0:15768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744786.828592:0:15768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744786.828593:0:15768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744786.828595:0:15768:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788744786.828597:0:15768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744786.828598:0:15768:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788744786.828607:0:15768:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788744786.828610:0:15768:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788744786.828611:0:15768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788744786.828612:0:15768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744786.828612:0:15768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744786.828613:0:15768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744786.828614:0:15768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744786.828615:0:15768:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788744786.828616:0:15768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744786.828617:0:15768:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788744786.828655:0:15768:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788744786.828679:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475334656:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788744786.828766:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744786.828898:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744786.829537:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475334656 00000100:00100000:1.0:1788744786.829548:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475334656 00000100:00100000:1.0:1788744786.829649:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788744786.829660:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+16:15768:x1875634475334656:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788744786.829712:0:14360:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788744786.829715:0:14360:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788744786.829719:0:14360:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788744786.838541:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+16:15768:x1875634475334656:12345-0@lo:253:mount.lustre.0 Request processed in 8872us (9764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744786.838557:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788744786.838663:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475334656:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788744786.838679:0:15768:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788744786.838683:0:15768:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788744786.838684:0:15768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788744786.838686:0:15768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744786.838687:0:15768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744786.838688:0:15768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744786.838689:0:15768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744786.838691:0:15768:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788744786.838693:0:15768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744786.838694:0:15768:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788744786.838715:0:15768:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93a20653f800 from lustre-OST0001 10000000:01000000:3.0:1788744786.838741:0:15768:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788744786.838744:0:15768:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788744786.838752:0:15768:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93a10625cd40 local copy 00010000:00010000:3.0:1788744786.838765:0:15768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81600/0x4b162761eb392f4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392f54 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744786.839486:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475334784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744786.839534:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744786.839653:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744786.839693:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475334784 00000100:00100000:0.0:1788744786.839701:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475334784 00000100:00100000:0.0:1788744786.839800:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788744786.839812:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a239459c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+16:15768:x1875634475334784:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744786.840656:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a239459c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+16:15768:x1875634475334784:12345-0@lo:501:mount.lustre.0 Request processed in 844us (1118us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788744786.840668:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788744786.841370:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475334784:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788744786.841394:0:15768:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788744786.841564:0:15768:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788744786.841573:0:15768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81600/0x4b162761eb392f4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392f54 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744786.841586:0:15768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a107e81600/0x4b162761eb392f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb392f54 expref: -99 pid: 14348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744786.841614:0:15768:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93a20653f800 10000000:01000000:3.0:1788744786.841618:0:15768:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788744786.841623:0:15768:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788744786.841625:0:15768:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744786.841630:0:15768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788744786.841644:0:15768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788744786.841675:0:15768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81800/0x4b162761eb3931ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744786.841683:0:15768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a107e81800/0x4b162761eb3931ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744786.841694:0:15768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a107e81800/0x4b162761eb3931ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744786.841715:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475334912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744786.841752:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744786.841931:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744786.842034:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475334912 00000100:00100000:0.0:1788744786.842041:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475334912 00000100:00100000:0.0:1788744786.842124:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788744786.842149:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a239458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+16:15768:x1875634475334912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744786.842163:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744786.842175:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a23d17f400/0x4b162761eb3931b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb3931ae expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744786.842213:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23d17f400/0x4b162761eb3931b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb3931ae expref: 17 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744786.842224:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a23d17f400/0x4b162761eb3931b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb3931ae expref: 17 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744786.842233:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17f400, rc 0) 00000100:00100000:0.0:1788744786.842464:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a239458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+17:15768:x1875634475334912:12345-0@lo:101:mount.lustre.0 Request processed in 333us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744786.842472:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788744786.842552:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475334912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744786.842570:0:15768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a107e81800/0x4b162761eb3931ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb3931b5 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744786.842578:0:15768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a107e81800/0x4b162761eb3931ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb3931b5 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744786.843179:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788744786.844111:0:15768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744786.844455:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788744786.844492:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788744786.844518:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788744786.844561:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788744786.844592:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788744786.844618:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788744786.844690:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788744786.844698:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788744786.844766:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475335040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744786.844816:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744786.845407:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744786.848399:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475335040 00000100:00100000:2.0:1788744786.848415:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475335040 00000100:00100000:2.0:1788744786.848481:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788744786.848492:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+17:15768:x1875634475335040:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744786.850382:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475335040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744786.850442:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475335168:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744786.850522:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+17:15768:x1875634475335040:12345-0@lo:501:mount.lustre.0 Request processed in 2029us (5703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744786.850533:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788744786.850717:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744786.850792:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744786.850953:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475335168 00000100:00100000:1.0:1788744786.850961:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475335168 00000100:00100000:1.0:1788744786.851050:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788744786.851374:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+17:15768:x1875634475335168:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744786.851913:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+17:15768:x1875634475335168:12345-0@lo:503:mount.lustre.0 Request processed in 853us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744786.851921:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788744786.852570:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475335168:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788744786.854397:0:15768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788744786.854483:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475335296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744786.854552:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744786.854674:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744786.854749:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475335296 00000100:00100000:1.0:1788744786.854757:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475335296 00000100:00100000:1.0:1788744786.854804:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788744786.854813:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a239458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+17:15768:x1875634475335296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744786.855476:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a239458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+17:15768:x1875634475335296:12345-0@lo:502:mount.lustre.0 Request processed in 662us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744786.855484:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788744786.855611:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475335296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788744786.856215:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788744786.856477:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788744786.856516:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788744786.856570:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788744786.856607:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788744786.856663:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788744786.856707:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788744786.856734:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788744786.856775:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788744786.857454:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475335424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744786.857534:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744786.857626:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744786.857703:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475335424 00000100:00100000:2.0:1788744786.857711:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475335424 00000100:00100000:2.0:1788744786.857803:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788744786.857815:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+17:15768:x1875634475335424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744786.858451:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+17:15768:x1875634475335424:12345-0@lo:502:mount.lustre.0 Request processed in 637us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744786.858459:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788744786.858612:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475335424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788744786.858735:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788744786.858748:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788744786.860714:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788744786.860725:0:15770:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788744786.860731:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744786.860734:0:15770:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788744786.860740:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788744786.860758:0:15770:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93a2064c3380) 00000020:00000080:0.0:1788744786.860785:0:15770:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788744786.860790:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788744786.860990:0:15770:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93a20653f800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788744786.860999:0:15770:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788744786.861365:0:15770:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b162761eb3931c3 00010000:00010000:2.0:1788744786.867965:0:15770:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788744786.869783:0:15770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788744786.874524:0:15770:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788744786.876809:0:15770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788744786.876832:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744786.876839:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744786.876841:0:15770:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788744786.876845:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744786.876848:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744786.876850:0:15770:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788744786.876853:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788744786.876864:0:15770:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788744786.876868:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744786.876870:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744786.876871:0:15770:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788744786.876873:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744786.876875:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744786.876877:0:15770:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788744786.876880:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788744786.876949:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744786.876952:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744786.876954:0:15770:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788744786.876957:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788744786.877777:0:15768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788744786.877828:0:15768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788744786.877853:0:15768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81800/0x4b162761eb3931ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb3931b5 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744786.877866:0:15768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a107e81800/0x4b162761eb3931ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb3931b5 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744786.877874:0:15768:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a20653f800 from 1 10000000:01000000:3.0:1788744786.877877:0:15768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788744786.877921:0:15768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb3931ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744786.877942:0:15768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb3931ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744786.877954:0:15768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb3931ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744786.877979:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475335552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744786.878229:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744786.878317:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744786.878533:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475335552 00000100:00100000:0.0:1788744786.878542:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475335552 00000100:00100000:0.0:1788744786.878596:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788744786.878606:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+17:15768:x1875634475335552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744786.878619:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744786.878643:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3931d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb3931ca expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744786.878682:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3931d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb3931ca expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744786.878694:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3931d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb3931ca expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744786.878703:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23d17fc00, rc 0) 00000100:00100000:0.0:1788744786.878754:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+18:15768:x1875634475335552:12345-0@lo:101:mount.lustre.0 Request processed in 149us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744786.878760:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788744786.878992:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475335552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744786.879016:0:15768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb3931ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb3931d1 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744786.879026:0:15768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb3931ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb3931d1 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744786.880363:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788744786.880709:0:15768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744786.882609:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788744786.882701:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788744786.882783:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788744786.882793:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788744786.884817:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475335680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744786.885365:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744786.886978:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744786.893241:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475335680 00000100:00100000:1.0:1788744786.893268:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475335680 00000100:00100000:1.0:1788744786.893334:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788744786.893345:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a239459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+18:15768:x1875634475335680:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744786.893679:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a239459850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+18:15768:x1875634475335680:12345-0@lo:501:mount.lustre.0 Request processed in 336us (8314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744786.893687:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788744786.893880:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475335680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744786.893942:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475335808:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744786.893990:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744786.894030:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744786.894321:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475335808 00000100:00100000:1.0:1788744786.894327:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475335808 00000100:00100000:1.0:1788744786.894355:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788744786.894362:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a239458050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+18:15768:x1875634475335808:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744786.894612:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a239458050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+18:15768:x1875634475335808:12345-0@lo:503:mount.lustre.0 Request processed in 250us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744786.894619:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788744786.894735:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475335808:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788744786.895487:0:15768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788744786.895569:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475335936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744786.895627:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744786.895662:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744786.896273:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475335936 00000100:00100000:0.0:1788744786.896281:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475335936 00000100:00100000:0.0:1788744786.896326:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788744786.896335:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a239458450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+18:15768:x1875634475335936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744786.896553:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a239458450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+18:15768:x1875634475335936:12345-0@lo:502:mount.lustre.0 Request processed in 219us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744786.896560:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788744786.897051:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475335936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788744786.897572:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788744786.897628:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788744786.897703:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788744786.897737:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788744786.897767:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788744786.897830:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788744786.897870:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788744786.898412:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788744786.898464:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475336064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744786.898535:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744786.898572:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2113e7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744786.898720:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475336064 00000100:00100000:0.0:1788744786.898727:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475336064 00000100:00100000:0.0:1788744786.898780:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788744786.898790:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2416dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+18:15768:x1875634475336064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744786.899243:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2416dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+18:15768:x1875634475336064:12345-0@lo:502:mount.lustre.0 Request processed in 453us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744786.899251:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788744786.899518:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475336064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788744786.899622:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788744786.899647:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788744786.904498:0:15774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744786.904515:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744786.904525:0:15774:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788744786.904533:0:15774:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93a20653f800 00000020:00000080:0.0:1788744786.904536:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788744786.904545:0:15774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744786.904548:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744786.904549:0:15774:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788744786.904552:0:15774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744786.904555:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744786.904556:0:15774:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788744786.904559:0:15774:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93a20653f800 00000020:00000080:0.0:1788744786.904561:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788744786.904629:0:15774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744786.904643:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744786.904645:0:15774:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788744786.904648:0:15774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744786.904650:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744786.904651:0:15774:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788744786.904655:0:15774:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93a20653f800 00000020:00000080:0.0:1788744786.904657:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788744786.904697:0:15774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744786.904702:0:15774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744786.904703:0:15774:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788744786.904707:0:15774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788744786.906290:0:15768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788744786.906326:0:15768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788744786.906350:0:15768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb3931ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb3931d1 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744786.906372:0:15768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb3931ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb3931d1 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744786.906419:0:15768:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788744786.906422:0:15768:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93a20653f800 10000000:01000000:3.0:1788744786.906426:0:15768:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93a20653f800 10000000:01000000:3.0:1788744786.906430:0:15768:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744786.906436:0:15768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93a20653f800 from 1 10000000:01000000:3.0:1788744786.906438:0:15768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788744786.906476:0:15768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80400/0x4b162761eb3931d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744786.906483:0:15768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a107e80400/0x4b162761eb3931d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744786.906494:0:15768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a107e80400/0x4b162761eb3931d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744786.906518:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475336192:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744786.906584:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744786.906642:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475336192 00000100:00100000:3.0:1788744786.906649:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475336192 00000100:00100000:3.0:1788744786.906692:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788744786.906701:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2416dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+18:15768:x1875634475336192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744786.906715:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744786.906726:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e80600/0x4b162761eb3931df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb3931d8 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744786.906757:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e80600/0x4b162761eb3931df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb3931d8 expref: 19 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744786.906767:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e80600/0x4b162761eb3931df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb3931d8 expref: 19 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744786.906776:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80600, rc 0) 00000100:00100000:3.0:1788744786.906807:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2416dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+19:15768:x1875634475336192:12345-0@lo:101:mount.lustre.0 Request processed in 107us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744786.906813:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788744786.906853:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c40b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788744786.906872:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475336192:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744786.906884:0:15768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a107e80400/0x4b162761eb3931d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb3931df expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744786.906893:0:15768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a107e80400/0x4b162761eb3931d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb3931df expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744786.907505:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788744786.907801:0:15768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744786.908043:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788744786.908088:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788744786.908124:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788744786.908202:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788744786.908239:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788744786.908283:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788744786.908330:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788744786.908365:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788744786.908422:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788744786.908460:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788744786.908494:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788744786.908557:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788744786.908595:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788744786.908629:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788744786.921582:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788744786.921624:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788744786.921675:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788744786.921723:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788744786.921757:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788744786.921788:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788744786.924598:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788744786.924730:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788744786.924792:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788744786.924862:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788744786.925574:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788744786.925617:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788744786.925684:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788744786.925720:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788744786.925754:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788744786.925797:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1788744786.925842:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1788744786.925872:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1788744786.925912:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788744786.925959:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788744786.925993:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788744786.926043:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788744786.926092:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788744786.929776:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788744786.929800:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788744786.929944:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475336320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744786.930035:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744786.930093:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c40b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744786.932184:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475336320 00000100:00100000:1.0:1788744786.932209:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475336320 00000100:00100000:1.0:1788744786.932284:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788744786.932296:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2416de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+19:15768:x1875634475336320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744786.932611:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2416de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+19:15768:x1875634475336320:12345-0@lo:501:mount.lustre.0 Request processed in 317us (2576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744786.932619:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788744786.938596:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475336320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744786.938685:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475336448:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744786.938782:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744786.942168:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475336448 00000100:00100000:2.0:1788744786.942187:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475336448 00000100:00100000:2.0:1788744786.942380:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788744786.942392:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2416ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+19:15768:x1875634475336448:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744786.943360:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c40b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788744786.944391:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2416ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+19:15768:x1875634475336448:12345-0@lo:503:mount.lustre.0 Request processed in 1996us (5603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744786.944405:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788744786.945116:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475336448:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788744786.945844:0:15768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788744786.948426:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475336576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744786.948526:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744786.948582:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23c40b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744786.948793:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475336576 00000100:00100000:1.0:1788744786.948802:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475336576 00000100:00100000:1.0:1788744786.948984:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788744786.948994:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2416df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+19:15768:x1875634475336576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744786.951493:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2416df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+19:15768:x1875634475336576:12345-0@lo:502:mount.lustre.0 Request processed in 2494us (2959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744786.951506:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788744786.953363:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475336576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788744786.953687:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788744786.953754:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788744786.953786:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788744786.953832:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788744786.953867:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788744786.955702:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788744786.955821:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788744786.955858:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788744786.956860:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788744786.956956:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788744786.956996:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788744786.957121:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788744786.957177:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788744786.957213:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788744786.957264:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788744786.957302:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788744786.957336:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788744786.957383:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788744786.957414:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788744786.957444:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788744786.957486:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788744786.957517:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788744786.957581:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788744786.957621:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788744786.957666:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788744786.957696:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788744786.957742:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788744786.957774:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788744786.957806:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788744786.957852:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788744786.957890:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788744786.957924:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788744786.957959:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788744786.958002:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788744786.958264:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788744786.958320:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788744786.958357:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788744786.958389:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788744786.958454:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788744786.958490:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788744786.958658:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475336704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744786.958742:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744786.958784:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744786.959719:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475336704 00000100:00100000:1.0:1788744786.959730:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475336704 00000100:00100000:1.0:1788744786.959779:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788744786.959788:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2416df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+19:15768:x1875634475336704:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744786.960669:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2416df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+19:15768:x1875634475336704:12345-0@lo:502:mount.lustre.0 Request processed in 879us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744786.960680:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788744786.960780:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475336704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788744786.960904:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788744786.960921:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788744786.968032:0:15779:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788744786.968049:0:15779:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93a2105499c0) 00000020:00000080:3.0:1788744786.968074:0:15779:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788744786.968181:0:15779:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93a20653f800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788744786.968185:0:15779:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93a20653f800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788744786.968188:0:15779:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93a20653f800 3 00010000:00080000:3.0:1788744786.968224:0:15779:0:(ldlm_lib.c:103:import_set_conn()) imp ffff93a23b4ea000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1788744786.976037:0:15779:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788744786.976280:0:15779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788744786.976323:0:15779:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788744786.976335:0:15779:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4b162761eb3931ed 00000100:00080000:3.0:1788744786.976347:0:15779:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744786.976360:0:15779:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93a23b4ea000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1788744786.976401:0:15779:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23c781880 x1875634475336832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744786.976447:0:15779:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788744786.977772:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875634475336832:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788744786.977871:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744786.979266:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475336832 00000100:00100000:1.0:1788744786.979279:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475336832 00000100:00100000:1.0:1788744786.979330:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744786.979340:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875634475336832:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788744786.979373:0:14366:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:1.0:1788744786.981506:0:14366:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4b162761eb3931f4 00000004:00100000:1.0:1788744786.981540:0:14366:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788744786.981618:0:14366:0:(import.c:65:import_set_state_nolock()) ffff93a210e7b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744786.981736:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875634475336832:12345-0@lo:38:llog_process_th.0 Request processed in 2394us (3862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744786.981754:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788744786.981887:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23c781880 x1875634475336832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744786.981900:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744786.981909:0:3306:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788744786.981917:0:3306:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788744786.981921:0:3306:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788744786.981924:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a23b4ea000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788744786.981929:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875634475336832:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788744786.982005:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744786.982012:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788744786.982015:0:38:0:(import.c:65:import_set_state_nolock()) ffff93a204f17000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744786.982019:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:3.0:1788744786.982023:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788744786.982031:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93a204f17000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1788744786.982047:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475336960:0@lo:400:kworker.0 00000100:00100000:3.0:1788744786.982095:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744786.982194:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23d569c00 x1875634475337088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744786.985024:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475336960 00000100:00100000:0.0:1788744786.985038:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475336960 00000100:00100000:0.0:1788744786.985111:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744786.985121:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475336960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744786.985228:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475336960:12345-0@lo:400:kworker.0 Request processed in 109us (3133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744786.985236:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744786.987379:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475337216:0@lo:400:kworker.0 00000100:00100000:1.0:1788744786.987453:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744786.987499:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744786.987507:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d56a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475337344:0@lo:400:kworker.0 00000100:00100000:1.0:1788744786.987531:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744786.987671:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475337216 00000100:00100000:0.0:1788744786.987680:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475337216 00000100:00100000:0.0:1788744786.987726:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475337344 00000100:00100000:0.0:1788744786.987729:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475337344 00000100:00100000:0.0:1788744786.987761:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788744786.987772:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475337216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744786.987830:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475337216:12345-0@lo:400:kworker.0 Request processed in 60us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744786.987838:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788744786.987857:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788744786.987864:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475337344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744786.987893:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475337344:12345-0@lo:400:kworker.0 Request processed in 30us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744786.987899:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788744786.988295:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475337088:0@lo:8:kworker.0 00000100:00100000:0.0:1788744786.988327:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744786.988363:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475337088 00000100:00100000:0.0:1788744786.988367:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475337088 00000100:00100000:0.0:1788744786.988389:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744786.988394:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875634475337088:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788744786.988442:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875634475337088:12345-0@lo:8:kworker.0 Request processed in 47us (113us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788744786.988449:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744786.988479:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744786.988486:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a204f17000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744786.988490:0:3306:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788744786.988493:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475337088:0@lo:8:kworker.0 00000100:00100000:3.0:1788744786.988888:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788744786.988902:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475336960:0@lo:400:kworker.0 00000040:00080000:3.0:1788744786.989105:0:15779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788744786.993975:0:15768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788744786.994013:0:15768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788744786.994036:0:15768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e80400/0x4b162761eb3931d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb3931df expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744786.994049:0:15768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a107e80400/0x4b162761eb3931d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb3931df expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788744786.994102:0:15768:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788744786.994105:0:15768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744786.994106:0:15768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744786.994112:0:15768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744786.994114:0:15768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744786.994115:0:15768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744786.994116:0:15768:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744786.994118:0:15768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744786.994120:0:15768:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744786.994123:0:15768:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788744786.994125:0:15768:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744786.994126:0:15768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744786.994149:0:15768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744786.994150:0:15768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744786.994150:0:15768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744786.994151:0:15768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744786.994152:0:15768:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744786.994153:0:15768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744786.994154:0:15768:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744786.994195:0:15768:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788744786.994216:0:15768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475337472:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788744786.994285:0:15768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744786.994321:0:15768:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23f861cc0 going to sleep for 11 seconds 00010000:00080000:1.0:1788744786.994664:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23d56a300 x1875634475337344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744786.994678:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d56a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475337344:0@lo:400:kworker.0 00010000:00080000:1.0:1788744786.994691:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93a23d568e00 x1875634475337216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744786.994698:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475337216:0@lo:400:kworker.0 00000100:00100000:1.0:1788744786.994733:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475337472 00000100:00100000:1.0:1788744786.994739:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475337472 00000100:00100000:1.0:1788744786.994823:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788744786.994833:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a2416de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+19:15768:x1875634475337472:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788744786.994860:0:14360:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788744786.994873:0:14360:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788744787.017752:0:14360:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788744787.017779:0:14360:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788744787.019584:0:14382:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788744787.019594:0:14382:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788744787.019620:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93a2064f2c00/0x4b162761eb3931fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744787.019648:0:14382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a23051b600/0x4b162761eb3930ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb3930c7 expref: 19 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744787.019658:0:14382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93a2064f2c00/0x4b162761eb3931fb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744787.019709:0:14382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a23051b600/0x4b162761eb3930ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb3930c7 expref: 19 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744787.019723:0:14382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93a23051b600/0x4b162761eb3930ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb3930c7 expref: 19 pid: 14361 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744787.019761:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14382:1875634475337600:0@lo:104: 00000100:00100000:2.0:1788744787.019846:0:14382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744787.020092:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23f8619c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744787.020165:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475337600 00000100:00100000:0.0:1788744787.020173:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475337600 00000100:00100000:0.0:1788744787.020227:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744787.020236:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85c0995c-9591-4016-879e-a5185771e142+3:14382:x1875634475337600:12345-0@lo:104: 00010000:00010000:0.0:1788744787.020256:0:14349:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a2064f2400/0x4b162761eb3930c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb3930ce expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744787.020321:0:14349:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788744787.020328:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:85c0995c-9591-4016-879e-a5185771e142+3:14382:x1875634475337600:12345-0@lo:104: Request processed in 93us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744787.020336:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788744787.020362:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744787.020368:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a2064f2400/0x4b162761eb3930c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb3930ce expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744787.020376:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2400 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:0.0:1788744787.020380:0:14354:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a2064f2400/0x4b162761eb3930c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb3930ce expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744787.020389:0:14354:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a2064f2400/0x4b162761eb3930c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb3930ce expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744787.020397:0:14354:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a2064f2400/0x4b162761eb3930c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb3930ce expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744787.020402:0:14354:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744787.020431:0:14354:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a2064f2400/0x4b162761eb3930c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb3930ce expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744787.020438:0:14354:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744787.020456:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a2064f2400/0x4b162761eb3930c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb3930ce expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744787.020464:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a2064f2400/0x4b162761eb3930c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb3930ce expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744787.020486:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744787.020488:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744787.020490:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744787.020682:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85c0995c-9591-4016-879e-a5185771e142:3309:1875634475337728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744787.020723:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744787.020798:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14382:1875634475337600:0@lo:104: 00010000:00010000:3.0:1788744787.020817:0:14382:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93a2064f2c00/0x4b162761eb3931fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744787.020863:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475337728 00000100:00100000:2.0:1788744787.020868:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475337728 00010000:00010000:2.0:1788744787.020901:0:14351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a23051b600/0x4b162761eb3930ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb3930c7 expref: 20 pid: 14361 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744787.020933:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744787.020941:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85c0995c-9591-4016-879e-a5185771e142+20:3309:x1875634475337728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744787.020952:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744787.020957:0:14351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a23051b600/0x4b162761eb3930ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb3930c7 expref: 20 pid: 14361 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744787.020968:0:14351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a23051b600/0x4b162761eb3930ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb3930c7 expref: 20 pid: 14361 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744787.020981:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a23051b600/0x4b162761eb3930ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb3930c7 expref: 20 pid: 14361 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744787.020992:0:14351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93a2064f2c00/0x4b162761eb3931fb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744787.021000:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2064f2c00/0x4b162761eb3931fb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788744787.021012:0:14351:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001420208s 00010000:00010000:2.0:1788744787.021017:0:14351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a2064f2c00/0x4b162761eb3931fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744787.021036:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a2064f2c00/0x4b162761eb3931fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744787.021043:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93a2064f2c00/0x4b162761eb3931fb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744787.021049:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93a2064f2c00/0x4b162761eb3931fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744787.021055:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2c00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744787.021059:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93a2064f2c00/0x4b162761eb3931fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744787.021066:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93a2064f2c00/0x4b162761eb3931fb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744787.021078:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93a2064f2c00/0x4b162761eb3931fb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744787.021087:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744787.021117:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d568000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85c0995c-9591-4016-879e-a5185771e142+19:3309:x1875634475337728:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744787.021124:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744787.021238:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85c0995c-9591-4016-879e-a5185771e142:3309:1875634475337728:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744787.021255:0:14382:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93a2064f2c00/0x4b162761eb3931fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744787.021269:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93a2064f2c00/0x4b162761eb3931fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744787.021275:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2064f2c00/0x4b162761eb3931fb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744787.026414:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a2416de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+18:15768:x1875634475337472:12345-0@lo:253:mount.lustre.0 Request processed in 31573us (32120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744787.026430:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788744787.026550:0:15768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:85c0995c-9591-4016-879e-a5185771e142:15768:1875634475337472:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788744787.026568:0:15768:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788744787.026572:0:15768:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788744787.026573:0:15768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788744787.026575:0:15768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744787.026576:0:15768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744787.026578:0:15768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744787.026579:0:15768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744787.026581:0:15768:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788744787.026582:0:15768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744787.026584:0:15768:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788744787.026599:0:15768:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788744787.030852:0:15768:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788744787.031378:0:15768:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788744787.031555:0:15768:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788744787.031745:0:15768:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788744787.031918:0:15768:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788744787.032176:0:15768:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788744787.033176:0:15768:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788744787.087471:0:15768:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788744787.087479:0:15768:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788744787.087530:0:15768:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788744787.087808:0:15768:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788744787.087893:0:15768:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788744787.087926:0:15768:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788744787.124609:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744787.446207:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788744788.148636:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788744788.474159:0:14363:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788744788.474169:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93a23bd31800 from 8 10000000:01000000:0.0:1788744788.474176:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788744788.474228:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e400/0x4b162761eb393202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744788.474241:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a23d17e400/0x4b162761eb393202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744788.474252:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a23d17e400/0x4b162761eb393202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744788.474280:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475337856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744788.474359:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744788.474414:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788744788.474423:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475337856 00000100:00100000:3.0:1788744788.474432:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475337856 00000100:00100000:3.0:1788744788.474494:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788744788.474505:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+18:14363:x1875634475337856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744788.474518:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744788.479382:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2064f2000/0x4b162761eb393209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb393202 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744788.479437:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2064f2000/0x4b162761eb393209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb393202 expref: 19 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744788.479454:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2064f2000/0x4b162761eb393209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb393202 expref: 19 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744788.479465:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2000, rc 0) 00000100:00100000:2.0:1788744788.479573:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+19:14363:x1875634475337856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5069us (5213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744788.479583:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788744788.483616:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475337856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744788.483645:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a23d17e400/0x4b162761eb393202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb393209 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744788.483658:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a23d17e400/0x4b162761eb393202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb393209 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744788.483730:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475337984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788744788.483795:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744788.483844:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204a9f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788744788.483872:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475337984 00000100:00100000:0.0:1788744788.483878:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475337984 00000100:00100000:0.0:1788744788.483916:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788744788.483923:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+19:14363:x1875634475337984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788744788.483941:0:14360:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788744788.483956:0:14360:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788744788.483959:0:14360:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788744788.484048:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+19:14363:x1875634475337984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744788.484055:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788744788.484099:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475337984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788744788.484174:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788744788.484181:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a23d17e400/0x4b162761eb393202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb393209 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744788.484190:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a23d17e400/0x4b162761eb393202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb393209 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744789.187314:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744790.198922:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744790.324777:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475338112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744790.324972:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744790.325696:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475338112 00000100:00100000:1.0:1788744790.325706:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475338112 00000100:00100000:1.0:1788744790.325760:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744790.325769:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475338112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744790.325813:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744790.325880:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475338112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744790.325888:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744790.326124:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475338112:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788744790.326712:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788744791.221392:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.245482:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788744792.381355:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788744792.381361:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788744792.381365:0:8:0:(import.c:65:import_set_state_nolock()) ffff93a204f17000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744792.381381:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93a204f17000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788744792.381413:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93a23d438a80 x1875634475338496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744792.381889:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85c0995c-9591-4016-879e-a5185771e142:3307:1875634475338240:0@lo:400:kworker.0 00000100:00100000:0.0:1788744792.381955:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744792.381997:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475338880:0@lo:400:kworker.0 00000100:00100000:0.0:1788744792.382022:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744792.382046:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744792.382052:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475338368:0@lo:400:kworker.0 00000100:00100000:0.0:1788744792.382074:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744792.382104:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475338496:0@lo:8:kworker.0 00000100:00100000:0.0:1788744792.382126:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744792.382175:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475338624:0@lo:400:kworker.0 00000100:00100000:0.0:1788744792.382215:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744792.382234:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744792.382239:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475338752:0@lo:400:kworker.0 00000100:00100000:0.0:1788744792.382263:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744792.382616:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475338240 00000100:00100000:0.0:1788744792.382625:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475338240 00000100:00100000:0.0:1788744792.382668:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788744792.382676:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d600c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+19:3307:x1875634475338240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744792.382766:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d600c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+19:3307:x1875634475338240:12345-0@lo:400:kworker.0 Request processed in 90us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744792.382774:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788744792.382805:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475338880 00000100:00100000:0.0:1788744792.382809:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475338880 00000100:00100000:0.0:1788744792.382852:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475338624 00000100:00100000:0.0:1788744792.382855:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475338624 00000100:00100000:0.0:1788744792.382867:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475338752 00000100:00100000:0.0:1788744792.382869:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475338752 00000100:00100000:0.0:1788744792.382882:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744792.382888:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475338880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744792.382919:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475338880:12345-0@lo:400:kworker.0 Request processed in 31us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744792.382924:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744792.382936:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744792.382984:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475338624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744792.383019:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475338624:12345-0@lo:400:kworker.0 Request processed in 77us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744792.383025:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744792.383038:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788744792.383044:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475338752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744792.383070:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634475338752:12345-0@lo:400:kworker.0 Request processed in 27us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744792.383076:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788744792.383093:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475338368 00000100:00100000:0.0:1788744792.383097:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475338368 00000100:00100000:0.0:1788744792.383120:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475338496 00000100:00100000:0.0:1788744792.383122:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475338496 00000100:00100000:0.0:1788744792.383159:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744792.383165:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475338368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744792.383194:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475338368:12345-0@lo:400:kworker.0 Request processed in 30us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744792.383210:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744792.383222:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788744792.383225:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3306:x1875634475338496:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788744792.383250:0:15051:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:0.0:1788744792.383279:0:15051:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b162761eb393210 00002000:00100000:0.0:1788744792.383293:0:15051:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93a104b55000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788744792.383297:0:15051:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788744792.383300:0:15051:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788744792.383618:0:15051:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788744792.383643:0:15051:0:(import.c:65:import_set_state_nolock()) ffff93a104b57000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744792.383689:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875634475338496:12345-0@lo:8:kworker.0 Request processed in 462us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744792.383697:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788744792.383729:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744792.383733:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788744792.383774:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23d438a80 x1875634475338496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788744817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788744792.383791:0:3306:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788744792.383800:0:3306:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788744792.383805:0:3306:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788744792.383808:0:3306:0:(import.c:65:import_set_state_nolock()) ffff93a204f17000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788744792.383828:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788744792.383833:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875634475338496:0@lo:8:kworker.0 00010000:00080000:0.0:1788744792.383866:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23d43ad80 x1875634475338752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744792.383887:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634475338752:0@lo:400:kworker.0 00010000:00080000:0.0:1788744792.383898:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23d43b800 x1875634475338624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744792.383906:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475338624:0@lo:400:kworker.0 00000100:00100000:0.0:1788744792.383936:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475338368:0@lo:400:kworker.0 00000100:00100000:0.0:1788744792.383944:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85c0995c-9591-4016-879e-a5185771e142:3307:1875634475338240:0@lo:400:kworker.0 00010000:00080000:0.0:1788744792.383952:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23d43bb80 x1875634475338880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744792.383959:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475338880:0@lo:400:kworker.0 00000004:00080000:2.0:1788744792.384175:0:14390:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788744792.384743:0:14390:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 495083611840ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788744792.394389:0:14391:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788744792.394420:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14391:1875634475339136:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788744792.394486:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744792.394515:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2033950c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744792.394532:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475339008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744792.394578:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744792.394620:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475339136 00000100:00100000:0.0:1788744792.394628:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475339136 00000100:00100000:0.0:1788744792.394680:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788744792.394689:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14391:x1875634475339136:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788744792.395816:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475339008 00000100:00100000:1.0:1788744792.395826:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475339008 00000100:00100000:1.0:1788744792.395865:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744792.395874:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875634475339008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744792.395904:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744792.395968:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875634475339008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744792.395976:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788744792.396021:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93a23d43bb80 x1875634475339008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744792.396042:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475339008:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788744792.414197:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1788744792.416584:0:15051:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788744792.416598:0:15051:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788744792.416605:0:15051:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1788744792.429331:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.429346:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb393217 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.429366:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.429372:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.429378:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb393217 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.429398:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb393217 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.429409:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb393217 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.429416:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb393217 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.429437:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.429452:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.429458:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb393217 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.429465:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ee00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.429469:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb393217 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.429490:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb393217 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.429506:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb393217 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.429514:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb393217 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.429530:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.429531:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.429533:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.430555:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.430565:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb39321e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.430579:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.430583:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.430588:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb39321e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.430600:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb39321e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.430609:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb39321e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.430623:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb39321e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.430639:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.431478:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.431487:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb39321e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.431497:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f600 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.431502:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb39321e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.431510:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb39321e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.431526:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb39321e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.431532:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb39321e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.431562:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.431564:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.431566:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.432614:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.432629:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb393225 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.432643:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.432647:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.432652:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb393225 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.432664:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb393225 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.432674:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb393225 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.432682:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb393225 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.435479:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788744792.436042:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.436051:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb39322c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.436067:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.436072:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.436077:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb39322c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.436093:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb39322c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.436109:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb39322c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.436116:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb39322c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744792.440230:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744792.440247:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb393225 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744792.440262:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f000 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744792.440267:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb393225 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744792.440280:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb393225 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744792.440323:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb393225 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744792.440331:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb393225 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744792.440360:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744792.440365:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb39322c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744792.440371:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f200 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:1.0:1788744792.440375:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb39322c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744792.440383:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb39322c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744792.440392:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb39322c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744792.440399:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744792.440400:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744792.440403:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.445001:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788744792.445019:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb39322c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.445065:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.445747:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.445755:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb393233 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.445769:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.445774:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.445780:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb393233 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.445797:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb393233 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.445807:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb393233 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.445826:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb393233 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.445844:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.445855:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.445861:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb393233 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.445870:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17fa00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.445874:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb393233 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.445883:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb393233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.445900:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb393233 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.445908:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb393233 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.445922:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.445923:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.445925:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.446355:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.446368:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb39323a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446377:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.446380:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.446383:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb39323a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446392:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb39323a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446400:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb39323a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446408:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb39323a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446425:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.446434:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.446437:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb39323a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446444:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ee00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.446447:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb39323a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446454:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb39323a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446470:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb39323a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446477:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005491afeb/0x4b162761eb39323a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446489:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.446490:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.446492:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.446872:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.446878:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e890ada2/0x4b162761eb393241 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446887:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.446890:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.446894:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e890ada2/0x4b162761eb393241 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446903:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e890ada2/0x4b162761eb393241 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446911:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e890ada2/0x4b162761eb393241 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446918:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e890ada2/0x4b162761eb393241 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446942:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.446952:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.446956:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e890ada2/0x4b162761eb393241 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446962:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e000 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.446965:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e890ada2/0x4b162761eb393241 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446973:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e890ada2/0x4b162761eb393241 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446983:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e890ada2/0x4b162761eb393241 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.446989:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e890ada2/0x4b162761eb393241 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.447001:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.447003:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.447004:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.447414:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.447420:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085907d6a/0x4b162761eb393248 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.447428:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.447437:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.447442:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085907d6a/0x4b162761eb393248 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.447451:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085907d6a/0x4b162761eb393248 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.447459:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085907d6a/0x4b162761eb393248 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.447467:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085907d6a/0x4b162761eb393248 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.447482:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.447491:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.447503:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085907d6a/0x4b162761eb393248 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.447510:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17ec00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.447513:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085907d6a/0x4b162761eb393248 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.447520:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085907d6a/0x4b162761eb393248 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.447531:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085907d6a/0x4b162761eb393248 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.447561:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085907d6a/0x4b162761eb393248 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.447575:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.447577:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.447579:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.447987:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.447994:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000347e42b2/0x4b162761eb39324f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.448003:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.448006:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.448010:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000347e42b2/0x4b162761eb39324f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.448019:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000347e42b2/0x4b162761eb39324f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.448026:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000347e42b2/0x4b162761eb39324f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.448032:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000347e42b2/0x4b162761eb39324f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.448045:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.448055:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.448066:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000347e42b2/0x4b162761eb39324f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.448073:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e600 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.448076:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000347e42b2/0x4b162761eb39324f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.448083:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000347e42b2/0x4b162761eb39324f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.448095:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000347e42b2/0x4b162761eb39324f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.448103:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000347e42b2/0x4b162761eb39324f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.448118:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.448120:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.448121:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.455690:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.455706:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b301a355/0x4b162761eb393256 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.455723:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.455728:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.455735:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b301a355/0x4b162761eb393256 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.455767:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b301a355/0x4b162761eb393256 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.455778:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b301a355/0x4b162761eb393256 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.455786:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b301a355/0x4b162761eb393256 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.455805:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.455819:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.455825:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b301a355/0x4b162761eb393256 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.455833:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238530800 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.455837:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b301a355/0x4b162761eb393256 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.455846:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b301a355/0x4b162761eb393256 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.455862:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b301a355/0x4b162761eb393256 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.455869:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b301a355/0x4b162761eb393256 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.455899:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.455901:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.455902:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.456586:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.456594:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35fe377/0x4b162761eb39325d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.456605:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.456609:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.456613:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b35fe377/0x4b162761eb39325d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.456623:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b35fe377/0x4b162761eb39325d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.456631:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35fe377/0x4b162761eb39325d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.456638:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b35fe377/0x4b162761eb39325d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.456653:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.456663:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.456668:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b35fe377/0x4b162761eb39325d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.456685:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238530a00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.456689:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35fe377/0x4b162761eb39325d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.456696:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35fe377/0x4b162761eb39325d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.456707:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b35fe377/0x4b162761eb39325d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.456713:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b35fe377/0x4b162761eb39325d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.456727:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.456728:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.456730:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.457108:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.457114:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014b61f67/0x4b162761eb393264 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457123:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.457126:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.457162:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014b61f67/0x4b162761eb393264 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457173:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014b61f67/0x4b162761eb393264 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457187:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014b61f67/0x4b162761eb393264 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457194:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014b61f67/0x4b162761eb393264 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457207:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.457216:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.457221:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014b61f67/0x4b162761eb393264 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457227:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238531e00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.457230:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014b61f67/0x4b162761eb393264 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457238:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014b61f67/0x4b162761eb393264 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457249:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014b61f67/0x4b162761eb393264 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457255:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014b61f67/0x4b162761eb393264 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457268:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.457276:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.457277:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.457669:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.457675:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afc6e81f/0x4b162761eb39326b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457684:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.457687:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.457690:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afc6e81f/0x4b162761eb39326b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457700:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afc6e81f/0x4b162761eb39326b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457707:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afc6e81f/0x4b162761eb39326b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457714:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afc6e81f/0x4b162761eb39326b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457728:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.457737:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.457741:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afc6e81f/0x4b162761eb39326b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457748:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238531a00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.457751:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afc6e81f/0x4b162761eb39326b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457771:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afc6e81f/0x4b162761eb39326b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457782:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afc6e81f/0x4b162761eb39326b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457789:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afc6e81f/0x4b162761eb39326b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.457801:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.457802:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.457804:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.458199:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.458205:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0c7837e/0x4b162761eb393272 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.458214:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.458217:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.458221:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0c7837e/0x4b162761eb393272 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.458231:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0c7837e/0x4b162761eb393272 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.458239:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0c7837e/0x4b162761eb393272 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.458252:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0c7837e/0x4b162761eb393272 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.458266:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.458275:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.458279:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0c7837e/0x4b162761eb393272 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.458285:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238531400 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.458288:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0c7837e/0x4b162761eb393272 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.458296:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0c7837e/0x4b162761eb393272 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.458308:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0c7837e/0x4b162761eb393272 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.458315:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0c7837e/0x4b162761eb393272 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.458329:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.458331:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.458332:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.463853:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.463876:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbf6bb80/0x4b162761eb393279 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.463894:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.463899:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.463905:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf6bb80/0x4b162761eb393279 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.463920:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbf6bb80/0x4b162761eb393279 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.463930:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbf6bb80/0x4b162761eb393279 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.463938:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbf6bb80/0x4b162761eb393279 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.463957:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.463974:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.463980:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbf6bb80/0x4b162761eb393279 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.463987:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238531600 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.463991:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbf6bb80/0x4b162761eb393279 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.463999:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbf6bb80/0x4b162761eb393279 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.464021:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbf6bb80/0x4b162761eb393279 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.464028:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbf6bb80/0x4b162761eb393279 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.464045:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.464047:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.464049:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.470110:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.470124:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfe13a37/0x4b162761eb393280 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.470361:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.470365:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.470372:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfe13a37/0x4b162761eb393280 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.470388:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfe13a37/0x4b162761eb393280 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.470399:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfe13a37/0x4b162761eb393280 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.470408:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfe13a37/0x4b162761eb393280 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.470441:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744792.470730:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744792.470738:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfe13a37/0x4b162761eb393280 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.470747:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238530c00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744792.470751:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfe13a37/0x4b162761eb393280 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.470771:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfe13a37/0x4b162761eb393280 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.470790:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfe13a37/0x4b162761eb393280 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.470797:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfe13a37/0x4b162761eb393280 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.470816:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744792.470818:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744792.470820:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.473644:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.473661:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc879c59/0x4b162761eb393287 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.473681:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.473686:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.473692:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc879c59/0x4b162761eb393287 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.473707:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc879c59/0x4b162761eb393287 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.473717:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc879c59/0x4b162761eb393287 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.473724:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc879c59/0x4b162761eb393287 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.473752:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744792.474682:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744792.474691:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc879c59/0x4b162761eb393287 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.474703:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238530000 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744792.474707:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc879c59/0x4b162761eb393287 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.474718:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc879c59/0x4b162761eb393287 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.474736:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc879c59/0x4b162761eb393287 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.474754:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc879c59/0x4b162761eb393287 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.474775:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744792.474777:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744792.474779:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.475246:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.475254:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5915fd2/0x4b162761eb39328e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.475264:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.475273:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.475278:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5915fd2/0x4b162761eb39328e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.475290:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5915fd2/0x4b162761eb39328e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.475299:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5915fd2/0x4b162761eb39328e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.475308:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5915fd2/0x4b162761eb39328e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.475328:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788744792.475735:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.475741:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000638044cc/0x4b162761eb393295 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.475750:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.475753:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.475757:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000638044cc/0x4b162761eb393295 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.475767:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000638044cc/0x4b162761eb393295 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.475775:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000638044cc/0x4b162761eb393295 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.475786:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000638044cc/0x4b162761eb393295 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.475797:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788744792.476168:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.476174:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb39329c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476182:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.476185:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.476190:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb39329c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476198:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb39329c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476206:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb39329c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476214:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb39329c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476228:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788744792.476240:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788744792.476244:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5915fd2/0x4b162761eb39328e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476257:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238530400 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.476261:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5915fd2/0x4b162761eb39328e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476270:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5915fd2/0x4b162761eb39328e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476284:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5915fd2/0x4b162761eb39328e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476290:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5915fd2/0x4b162761eb39328e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476307:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744792.476310:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000638044cc/0x4b162761eb393295 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476317:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a238531800 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.476320:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000638044cc/0x4b162761eb393295 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476327:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000638044cc/0x4b162761eb393295 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476335:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000638044cc/0x4b162761eb393295 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476346:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000638044cc/0x4b162761eb393295 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476357:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.476360:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb39329c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476365:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f000 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.476369:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb39329c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476376:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb39329c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476384:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb39329c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476391:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eba6d27/0x4b162761eb39329c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476402:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.476403:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.476405:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.476802:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.476808:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb3932a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476824:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.476827:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.476830:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb3932a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476839:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb3932a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476846:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb3932a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476853:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb3932a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476866:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.476874:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.476878:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb3932a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476883:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17fa00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.476886:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb3932a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476893:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb3932a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476914:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb3932a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476920:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007adf68ae/0x4b162761eb3932a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.476933:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.476934:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.476936:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.477350:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.477356:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb3932aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477365:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.477368:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.477372:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb3932aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477381:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb3932aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477390:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb3932aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477397:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb3932aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477423:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.477432:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.477436:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb3932aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477442:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f200 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.477445:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb3932aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477452:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb3932aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477464:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb3932aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477471:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004592dbc/0x4b162761eb3932aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477484:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.477486:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.477487:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.477889:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.477896:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb3932b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477903:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.477911:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.477916:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb3932b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477926:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb3932b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477935:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb3932b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477942:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb3932b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477956:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.477965:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.477968:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb3932b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477974:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17f600 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.477977:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb3932b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477984:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb3932b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.477994:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb3932b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.478011:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f60bc23f/0x4b162761eb3932b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.478027:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.478029:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.478031:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.478439:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.478445:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e9d60c2/0x4b162761eb3932b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.478455:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.478458:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.478462:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e9d60c2/0x4b162761eb3932b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.478471:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e9d60c2/0x4b162761eb3932b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.478478:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e9d60c2/0x4b162761eb3932b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.478484:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e9d60c2/0x4b162761eb3932b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.478499:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744792.478508:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744792.478517:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e9d60c2/0x4b162761eb3932b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.478523:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2048dd800 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744792.478527:0:15500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e9d60c2/0x4b162761eb3932b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.479069:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744792.479076:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.482957:0:15500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e9d60c2/0x4b162761eb3932b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.482996:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e9d60c2/0x4b162761eb3932b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.483004:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e9d60c2/0x4b162761eb3932b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.483030:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.483032:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744792.483035:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744792.484014:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744792.484023:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784e0020/0x4b162761eb3932bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.484037:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788744792.484042:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744792.484047:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000784e0020/0x4b162761eb3932bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.484072:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000784e0020/0x4b162761eb3932bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.484082:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784e0020/0x4b162761eb3932bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.484090:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000784e0020/0x4b162761eb3932bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744792.484110:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744792.487311:0:14354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744792.487324:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000784e0020/0x4b162761eb3932bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744792.487340:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2048dc000 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744792.487345:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000784e0020/0x4b162761eb3932bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744792.487354:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000784e0020/0x4b162761eb3932bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744792.487378:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000784e0020/0x4b162761eb3932bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744792.487385:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000784e0020/0x4b162761eb3932bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744792.487406:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744792.487407:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744792.487409:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744792.490890:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744792.490904:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000287326f3/0x4b162761eb3932c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744792.490921:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788744792.490932:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744792.490938:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000287326f3/0x4b162761eb3932c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744792.490954:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000287326f3/0x4b162761eb3932c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744792.490966:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000287326f3/0x4b162761eb3932c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744792.490974:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000287326f3/0x4b162761eb3932c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744792.490995:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788744792.491685:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744792.491694:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6e634f5/0x4b162761eb3932cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744792.491706:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=495s v=(0 0) 00010000:00010000:3.0:1788744792.491710:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744792.491713:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6e634f5/0x4b162761eb3932cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744792.491723:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6e634f5/0x4b162761eb3932cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744792.491731:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6e634f5/0x4b162761eb3932cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744792.491745:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6e634f5/0x4b162761eb3932cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744792.491765:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1788744792.491946:0:15051:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00010000:00010000:2.0:1788744792.492162:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744792.492170:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000287326f3/0x4b162761eb3932c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.492178:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80e00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744792.492182:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000287326f3/0x4b162761eb3932c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.492190:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000287326f3/0x4b162761eb3932c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.492217:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000287326f3/0x4b162761eb3932c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.492224:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000287326f3/0x4b162761eb3932c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.492244:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744792.492255:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6e634f5/0x4b162761eb3932cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.492261:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81a00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744792.492264:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6e634f5/0x4b162761eb3932cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.492272:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6e634f5/0x4b162761eb3932cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.492283:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6e634f5/0x4b162761eb3932cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.492290:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6e634f5/0x4b162761eb3932cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744792.492303:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744792.492305:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744792.492307:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744792.493610:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14391:x1875634475339136:12345-0@lo:5:osp-pre-1-0.0 Request processed in 98912us (99113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744792.493623:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788744792.496997:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14391:1875634475339136:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788744792.497020:0:14391:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788744792.497075:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14391:1875634475339264:0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1788744792.497197:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744792.499311:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744792.499376:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23f8619c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744792.499401:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475339264 00000100:00100000:0.0:1788744792.499409:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475339264 00000100:00100000:0.0:1788744792.499462:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788744792.499471:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14391:x1875634475339264:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788744792.499530:0:15049:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:0.0:1788744792.507338:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788744792.509042:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14391:x1875634475339264:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9565us (9730us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788744792.509053:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788744792.509119:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d439c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14391:1875634475339264:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788744792.509158:0:14391:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1788744793.268321:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788744794.105462:0:16126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788744794.293978:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744795.322831:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744795.445010:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744795.445041:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475339392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744795.445167:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744795.445367:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475339392 00000100:00100000:3.0:1788744795.445378:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475339392 00000100:00100000:3.0:1788744795.445450:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744795.445469:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475339392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744795.445520:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744795.445577:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475339392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744795.445584:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744795.445635:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d569f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475339392:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788744795.445892:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788744796.355962:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744796.706971:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744796.707021:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451225984 00000100:00100000:0.0:1788744796.707033:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451225984 00000100:00100000:0.0:1788744796.707084:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:0.0:1788744796.707094:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1875634451225984:12345-192.168.201.6@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788744796.707125:0:14361:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 02e5aaad-21c4-4c17-8f29-5f47c1c09893@192.168.201.6@tcp t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:0.0:1788744796.707171:0:14361:0:(genops.c:1384:class_connect()) connect: client 02e5aaad-21c4-4c17-8f29-5f47c1c09893, cookie 0x4b162761eb3932d4 00000100:00080000:0.0:1788744796.707303:0:14361:0:(import.c:65:import_set_state_nolock()) ffff93a104b51800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744796.707490:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+5:2358:x1875634451225984:12345-192.168.201.6@tcp:250:mount.lustre.0 Request processed in 395us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744796.707498:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:1.0:1788744796.719371:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744796.719487:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451226112 00000100:00100000:0.0:1788744796.719497:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451226112 00000100:00100000:0.0:1788744796.719562:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00100000:0.0:1788744796.719572:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+5:13726:x1875634451226112:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788744796.719591:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744796.719610:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2048dc600/0x4b162761eb3932db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d55223 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744796.719642:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2048dc600/0x4b162761eb3932db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55223 expref: 6 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744796.719677:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2048dc600/0x4b162761eb3932db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55223 expref: 6 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744796.719687:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2048dc600, rc 0) 00000100:00100000:0.0:1788744796.719751:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+6:13726:x1875634451226112:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 181us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744796.719758:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00100000:3.0:1788744796.723773:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744796.723863:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451226240 00000100:00100000:0.0:1788744796.723875:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451226240 00000100:00100000:0.0:1788744796.723938:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:0.0:1788744796.723948:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+6:13726:x1875634451226240:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788744796.724411:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+6:13726:x1875634451226240:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 461us (647us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788744796.724420:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:2.0:1788744796.730393:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744796.730846:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451226368 00000100:00100000:3.0:1788744796.730857:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451226368 00000100:00100000:3.0:1788744796.730966:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:3.0:1788744796.730979:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+6:13726:x1875634451226368:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788744796.731014:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744796.731040:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e81c00/0x4b162761eb3932e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d5522a expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744796.731071:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e81c00/0x4b162761eb3932e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5522a expref: 7 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744796.731081:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e81c00/0x4b162761eb3932e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5522a expref: 7 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744796.731090:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81c00, rc 0) 00000100:00100000:3.0:1788744796.731184:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+7:13726:x1875634451226368:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 209us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744796.731191:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:1.0:1788744796.743907:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744796.748377:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451226496 00000100:00100000:2.0:1788744796.748397:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451226496 00000100:00100000:2.0:1788744796.748480:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:2.0:1788744796.748491:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+7:13726:x1875634451226496:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788744796.749220:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+8:13726:x1875634451226496:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 727us (5323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744796.749237:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:1.0:1788744796.763986:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744796.764230:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451226624 00000100:00100000:3.0:1788744796.764241:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451226624 00000100:00100000:3.0:1788744796.764298:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:3.0:1788744796.764306:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+8:13726:x1875634451226624:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788744796.765675:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+8:13726:x1875634451226624:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 1351us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744796.765689:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:0.0:1788744796.768740:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744796.768844:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451226752 00000100:00100000:2.0:1788744796.768856:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451226752 00000100:00100000:2.0:1788744796.768914:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:2.0:1788744796.768925:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+8:13744:x1875634451226752:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744796.769289:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+8:13744:x1875634451226752:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 365us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744796.769295:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:1.0:1788744796.791250:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744796.791358:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451226880 00000100:00100000:0.0:1788744796.791369:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451226880 00000100:00100000:0.0:1788744796.791437:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:0.0:1788744796.791447:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+8:13744:x1875634451226880:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744796.791814:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+8:13744:x1875634451226880:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 366us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744796.791822:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:1.0:1788744796.801908:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744796.802099:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451227008 00000100:00100000:3.0:1788744796.802110:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451227008 00000100:00100000:3.0:1788744796.802214:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:3.0:1788744796.802225:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+8:13726:x1875634451227008:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788744796.802242:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744796.802279:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e81400/0x4b162761eb3932e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d55254 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744796.802311:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e81400/0x4b162761eb3932e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55254 expref: 9 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744796.802322:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e81400/0x4b162761eb3932e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55254 expref: 9 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744796.802330:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e81400, rc 0) 00000100:00100000:3.0:1788744796.802398:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+9:13726:x1875634451227008:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 175us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744796.802404:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:1.0:1788744796.809211:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744796.809298:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451227136 00000100:00100000:2.0:1788744796.809308:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451227136 00000100:00100000:2.0:1788744796.809361:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 83 00000100:00100000:2.0:1788744796.809370:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+9:13726:x1875634451227136:12345-192.168.201.6@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788744796.809406:0:14360:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788744796.809440:0:14360:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788744796.809444:0:14360:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788744796.809447:0:14360:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788744796.809449:0:14360:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788744796.812679:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+9:13726:x1875634451227136:12345-192.168.201.6@tcp:256:mount.lustre.0 Request processed in 3298us (3467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744796.812694:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 83 00000100:00100000:1.0:1788744796.823559:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744796.823681:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451227264 00000100:00100000:0.0:1788744796.823691:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451227264 00000100:00100000:0.0:1788744796.823759:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:0.0:1788744796.823787:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+9:13726:x1875634451227264:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788744796.823806:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744796.823824:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2048dc200/0x4b162761eb3932f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d5525b expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744796.823853:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2048dc200/0x4b162761eb3932f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5525b expref: 10 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744796.823864:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2048dc200/0x4b162761eb3932f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5525b expref: 10 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744796.823872:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2048dc200, rc 0) 00000100:00100000:0.0:1788744796.823931:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+10:13726:x1875634451227264:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 148us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744796.823938:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:1.0:1788744796.828332:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744796.829305:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451227392 00000100:00100000:2.0:1788744796.829623:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451227392 00000100:00100000:2.0:1788744796.829736:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:2.0:1788744796.829747:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+10:13726:x1875634451227392:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788744796.830034:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+10:13726:x1875634451227392:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 282us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744796.830049:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:1.0:1788744796.832732:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744796.832918:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451227520 00000100:00100000:0.0:1788744796.832927:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451227520 00000100:00100000:0.0:1788744796.832982:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:0.0:1788744796.832992:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+10:13726:x1875634451227520:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788744796.836938:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+10:13726:x1875634451227520:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 3937us (4206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744796.837341:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:1.0:1788744796.846045:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744796.847107:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451227648 00000100:00100000:0.0:1788744796.847120:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451227648 00000100:00100000:1.0:1788744796.848107:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 87 00000100:00100000:1.0:1788744796.848120:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+10:13748:x1875634451227648:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788744796.850427:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+10:13748:x1875634451227648:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 2300us (4386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744796.851606:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 87 00000100:00100000:1.0:1788744796.854373:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744796.859023:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451227776 00000100:00100000:3.0:1788744796.859036:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451227776 00000100:00100000:2.0:1788744796.859183:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 88 00000100:00100000:2.0:1788744796.859196:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+10:13748:x1875634451227776:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744796.859787:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+10:13748:x1875634451227776:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 590us (5419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744796.859796:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 88 00000100:00100000:3.0:1788744796.882319:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744796.882420:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451227904 00000100:00100000:0.0:1788744796.882431:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451227904 00000100:00100000:0.0:1788744796.882508:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:0.0:1788744796.882517:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1875634451227904:12345-192.168.201.6@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788744796.882563:0:14368:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 048fcf10-bca2-4fd1-9809-4e3b531d6735@192.168.201.6@tcp t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:0.0:1788744796.882622:0:14368:0:(genops.c:1384:class_connect()) connect: client 048fcf10-bca2-4fd1-9809-4e3b531d6735, cookie 0x4b162761eb3932f7 00000004:00100000:0.0:1788744796.882666:0:14368:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:0.0:1788744796.882673:0:14368:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788744796.959841:0:14368:0:(import.c:65:import_set_state_nolock()) ffff93a107941000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744796.959940:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:2358:x1875634451227904:12345-192.168.201.6@tcp:38:mount.lustre.0 Request processed in 77421us (77634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744796.959950:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:1.0:1788744796.963358:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744796.963404:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744796.963499:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451228160 00000100:00100000:2.0:1788744796.963509:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451228160 00000100:00100000:2.0:1788744796.963572:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451228032 00000100:00100000:2.0:1788744796.963576:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451228032 00000100:00100000:2.0:1788744796.963592:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:2.0:1788744796.963602:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+7:13726:x1875634451228160:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788744796.963657:0:14366:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788744796.963745:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+7:13726:x1875634451228160:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 143us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744796.963752:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:2.0:1788744796.963772:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:2.0:1788744796.963779:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:0:x1875634451228032:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788744796.963791:0:14366:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788744796.963812:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:0:x1875634451228032:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 34us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744796.963818:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00080000:1.0:1788744796.964895:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744796.967536:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744796.967651:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451228288 00000100:00100000:0.0:1788744796.967661:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451228288 00000100:00100000:0.0:1788744796.967729:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:0.0:1788744796.967739:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:13726:x1875634451228288:12345-192.168.201.6@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788744796.967833:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:13726:x1875634451228288:12345-192.168.201.6@tcp:40:mount.lustre.0 Request processed in 95us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744796.967840:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1788744796.970879:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744796.970921:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744796.970947:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744796.970972:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744796.970998:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451228416 00000100:00100000:3.0:1788744796.971007:0:15050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451228416 00000100:00100000:3.0:1788744796.971039:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451228544 00000100:00100000:3.0:1788744796.971042:0:15050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451228544 00000100:00100000:3.0:1788744796.971058:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:3.0:1788744796.971066:0:15050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875634451228416:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788744796.971096:0:15050:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 048fcf10-bca2-4fd1-9809-4e3b531d6735@192.168.201.6@tcp t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:3.0:1788744796.971162:0:15050:0:(genops.c:1384:class_connect()) connect: client 048fcf10-bca2-4fd1-9809-4e3b531d6735, cookie 0x4b162761eb3932fe 00002000:00100000:3.0:1788744796.971176:0:15050:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 048fcf10-bca2-4fd1-9809-4e3b531d6735/ffff93a207539000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788744796.971203:0:15050:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:2.0:1788744796.971830:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451228800 00000100:00100000:2.0:1788744796.971839:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451228800 00000100:00100000:2.0:1788744796.971872:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:2.0:1788744796.971880:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:13726:x1875634451228800:12345-192.168.201.6@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788744796.972433:0:14369:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 500us 00002000:00080000:3.0:1788744796.972888:0:15050:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788744796.972922:0:15050:0:(import.c:65:import_set_state_nolock()) ffff93a207538800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744796.972984:0:15050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:2358:x1875634451228416:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 1918us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744796.972992:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:3.0:1788744796.973013:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:3.0:1788744796.973018:0:15050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875634451228544:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788744796.973036:0:15050:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 048fcf10-bca2-4fd1-9809-4e3b531d6735@192.168.201.6@tcp t0 exp 0000000000000000 cur 499 last 0 00000100:00100000:0.0:1788744796.973210:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451228672 00000100:00100000:0.0:1788744796.973218:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451228672 00000100:00100000:0.0:1788744796.973249:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 89 00000100:00100000:0.0:1788744796.973256:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+10:2361:x1875634451228672:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744796.973287:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+10:2361:x1875634451228672:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 32us (2418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744796.973294:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 89 00000020:00000080:3.0:1788744796.974546:0:15050:0:(genops.c:1384:class_connect()) connect: client 048fcf10-bca2-4fd1-9809-4e3b531d6735, cookie 0x4b162761eb393305 00002000:00100000:3.0:1788744796.974563:0:15050:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 048fcf10-bca2-4fd1-9809-4e3b531d6735/ffff93a20753e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788744796.974589:0:15050:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788744796.977354:0:15050:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788744796.977401:0:15050:0:(import.c:65:import_set_state_nolock()) ffff93a20753a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744796.977481:0:15050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:2358:x1875634451228544:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 4460us (6505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744796.977491:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000004:00200000:0.0:1788744796.998719:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788744796.998849:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:13726:x1875634451228800:12345-192.168.201.6@tcp:33:mount.lustre.0 Request processed in 26963us (27920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744796.998864:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:3.0:1788744797.215324:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744797.215429:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451228928 00000100:00100000:2.0:1788744797.215439:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451228928 00000100:00100000:2.0:1788744797.215512:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:2.0:1788744797.215523:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:13769:x1875634451228928:12345-192.168.201.6@tcp:101:mkdir.0 00010000:00010000:2.0:1788744797.215542:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744797.215568:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb39330c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55285 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744797.215637:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb393313 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744797.215651:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb393313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744797.215665:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb393313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744797.215713:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788744797.215717:0:14367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744797.215762:0:14367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb393313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744797.215789:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb39330c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55285 expref: 8 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744797.215825:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb393313 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55285 expref: 7 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744797.215834:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:2.0:1788744797.215837:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744797.215840:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2a00, rc 0) 00000100:00100000:2.0:1788744797.215905:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+7:13769:x1875634451228928:12345-192.168.201.6@tcp:101:mkdir.0 Request processed in 384us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744797.215912:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00010000:00010000:3.0:1788744797.364940:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744797.492935:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475339904:0@lo:400:kworker.0 00000100:00100000:1.0:1788744797.493010:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744797.493094:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788744797.493101:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475339520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744797.493174:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744797.493198:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475340032:0@lo:400:kworker.0 00000100:00100000:1.0:1788744797.493221:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744797.493248:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475339776:0@lo:400:kworker.0 00000100:00100000:1.0:1788744797.493271:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744797.493286:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475340288:0@lo:400:kworker.0 00000100:00100000:1.0:1788744797.493311:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744797.493327:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788744797.493333:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85c0995c-9591-4016-879e-a5185771e142:3308:1875634475339648:0@lo:400:kworker.0 00000100:00100000:1.0:1788744797.493361:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744797.493380:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875634475340160:0@lo:400:kworker.0 00000100:00100000:1.0:1788744797.493399:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744797.493586:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475339904 00000100:00100000:2.0:1788744797.493596:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475339904 00000100:00100000:2.0:1788744797.493653:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475339776 00000100:00100000:2.0:1788744797.493657:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475339776 00000100:00100000:2.0:1788744797.493681:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744797.493690:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1875634475339904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744797.493747:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1875634475339904:12345-0@lo:400:kworker.0 Request processed in 57us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744797.493755:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744797.493776:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744797.493783:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475339776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744797.493816:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475339776:12345-0@lo:400:kworker.0 Request processed in 34us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744797.493822:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744797.493841:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475340032 00000100:00100000:2.0:1788744797.493844:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475340032 00000100:00100000:2.0:1788744797.493861:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475340288 00000100:00100000:2.0:1788744797.493871:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475340288 00000100:00100000:2.0:1788744797.493886:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475340160 00000100:00100000:2.0:1788744797.493889:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475340160 00000100:00100000:2.0:1788744797.493902:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744797.493908:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475340032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744797.493939:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634475340032:12345-0@lo:400:kworker.0 Request processed in 31us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744797.493944:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744797.493957:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788744797.493963:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475340288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744797.493988:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875634475340288:12345-0@lo:400:kworker.0 Request processed in 25us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744797.493994:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788744797.494005:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744797.494011:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875634475340160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744797.494037:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875634475340160:12345-0@lo:400:kworker.0 Request processed in 27us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744797.494057:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744797.494078:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475339648 00000100:00100000:2.0:1788744797.494082:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475339648 00000100:00100000:2.0:1788744797.494104:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788744797.494111:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+19:3308:x1875634475339648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744797.494283:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+19:3308:x1875634475339648:12345-0@lo:400:kworker.0 Request processed in 171us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744797.494290:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788744797.494336:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85c0995c-9591-4016-879e-a5185771e142:3308:1875634475339648:0@lo:400:kworker.0 00000100:00100000:2.0:1788744797.494366:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875634475340160:0@lo:400:kworker.0 00000100:00100000:2.0:1788744797.494376:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475339776:0@lo:400:kworker.0 00000100:00100000:2.0:1788744797.494402:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875634475340288:0@lo:400:kworker.0 00000100:00100000:2.0:1788744797.494435:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634475340032:0@lo:400:kworker.0 00000100:00100000:2.0:1788744797.494444:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475339904:0@lo:400:kworker.0 00000100:00100000:3.0:1788744797.494595:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475339520 00000100:00100000:3.0:1788744797.494600:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475339520 00000100:00100000:3.0:1788744797.494635:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744797.494644:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875634475339520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744797.494661:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744797.494703:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875634475339520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744797.494716:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744797.494769:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475339520:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788744797.494976:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744797.494982:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744797.494985:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788744797.663804:0:7638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788744797.663857:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788744797.665983:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 048fcf10-bca2-4fd1-9809-4e3b531d6735 00000040:00080000:3.0:1788744797.684819:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788744798.393399:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744799.412511:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744799.454802:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744799.455033:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451229056 00000100:00100000:2.0:1788744799.455044:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451229056 00000100:00100000:2.0:1788744799.455160:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1788744799.455172:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+7:13822:x1875634451229056:12345-192.168.201.6@tcp:41:lfs.0 00000004:00000024:2.0:1788744799.455216:0:14368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788744799.455319:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+7:13822:x1875634451229056:12345-192.168.201.6@tcp:41:lfs.0 Request processed in 149us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744799.455326:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00080000:1.0:1788744799.455405:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744799.462287:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744799.462407:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451229184 00000100:00100000:0.0:1788744799.462433:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451229184 00000100:00100000:0.0:1788744799.462527:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:0.0:1788744799.462538:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:13822:x1875634451229184:12345-192.168.201.6@tcp:13:lfs.0 00002000:00000024:0.0:1788744799.462592:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744799.462682:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:13822:x1875634451229184:12345-192.168.201.6@tcp:13:lfs.0 Request processed in 146us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744799.462692:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00080000:1.0:1788744799.462923:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744799.467278:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744799.467363:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451229312 00000100:00100000:3.0:1788744799.467374:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451229312 00000100:00100000:3.0:1788744799.467568:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1788744799.467580:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:13822:x1875634451229312:12345-192.168.201.6@tcp:13:lfs.0 00002000:00000024:3.0:1788744799.467619:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744799.467718:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:13822:x1875634451229312:12345-192.168.201.6@tcp:13:lfs.0 Request processed in 141us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744799.467726:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00080000:1.0:1788744799.477657:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744799.727697:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744799.732772:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451229440 00000100:00100000:0.0:1788744799.732787:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451229440 00000100:00100000:0.0:1788744799.732859:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00100000:0.0:1788744799.732869:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+10:13855:x1875634451229440:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788744799.732887:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744799.732907:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2048dd600/0x4b162761eb39331a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d5528c expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744799.732936:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2048dd600/0x4b162761eb39331a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5528c expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744799.732948:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2048dd600/0x4b162761eb39331a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5528c expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744799.732957:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2048dd600, rc 0) 00000100:00100000:0.0:1788744799.733030:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+11:13855:x1875634451229440:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 161us (5898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744799.733037:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00100000:2.0:1788744799.740844:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744799.741716:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451229568 00000100:00100000:0.0:1788744799.741727:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451229568 00000100:00100000:0.0:1788744799.741795:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:0.0:1788744799.741806:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+11:13855:x1875634451229568:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788744799.742181:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+11:13855:x1875634451229568:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 376us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744799.742189:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:3.0:1788744799.752686:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744799.752879:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451229696 00000100:00100000:2.0:1788744799.752890:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451229696 00000100:00100000:2.0:1788744799.752946:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 93 00000100:00100000:2.0:1788744799.752955:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+11:13855:x1875634451229696:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788744799.753251:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+11:13855:x1875634451229696:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 296us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744799.753260:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 93 00000100:00100000:3.0:1788744799.757333:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744799.757849:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451229824 00000100:00100000:2.0:1788744799.757876:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451229824 00000100:00100000:2.0:1788744799.757946:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:2.0:1788744799.757957:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+11:13861:x1875634451229824:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744799.758530:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+11:13861:x1875634451229824:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 573us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744799.758540:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:3.0:1788744799.777599:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744799.777771:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451229952 00000100:00100000:0.0:1788744799.777783:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451229952 00000100:00100000:0.0:1788744799.777853:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00100000:0.0:1788744799.777867:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+11:13861:x1875634451229952:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744799.778274:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+11:13861:x1875634451229952:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 410us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744799.778283:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00100000:3.0:1788744799.783257:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744799.783486:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451230080 00000100:00100000:2.0:1788744799.783496:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451230080 00000100:00100000:2.0:1788744799.783554:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 96 00000100:00100000:2.0:1788744799.783565:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+11:13855:x1875634451230080:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788744799.783582:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744799.783608:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2064f2600/0x4b162761eb393321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d552b6 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744799.783638:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2064f2600/0x4b162761eb393321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d552b6 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744799.783650:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2064f2600/0x4b162761eb393321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d552b6 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744799.783772:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2600, rc 0) 00000100:00100000:2.0:1788744799.783830:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+12:13855:x1875634451230080:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 266us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744799.783837:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 96 00000100:00100000:3.0:1788744799.793923:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744799.794114:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451230208 00000100:00100000:2.0:1788744799.794238:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451230208 00000100:00100000:3.0:1788744799.799692:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 97 00000100:00100000:3.0:1788744799.799708:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+12:13855:x1875634451230208:12345-192.168.201.6@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788744799.799737:0:14359:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788744799.799764:0:14359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788744799.799767:0:14359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788744799.799771:0:14359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788744799.799773:0:14359:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788744799.802086:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+12:13855:x1875634451230208:12345-192.168.201.6@tcp:256:mount.lustre.0 Request processed in 2371us (8163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744799.802100:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 97 00000100:00100000:2.0:1788744799.807956:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744799.808057:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451230336 00000100:00100000:0.0:1788744799.808069:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451230336 00000100:00100000:0.0:1788744799.808175:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:0.0:1788744799.808186:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+12:13855:x1875634451230336:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788744799.808207:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744799.808230:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2048dd400/0x4b162761eb393328 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d552bd expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744799.808263:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2048dd400/0x4b162761eb393328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d552bd expref: 13 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744799.808274:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2048dd400/0x4b162761eb393328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d552bd expref: 13 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744799.808308:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2048dd400, rc 0) 00000100:00100000:0.0:1788744799.808374:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:13855:x1875634451230336:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 190us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744799.808382:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:3.0:1788744799.811752:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744799.811857:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451230464 00000100:00100000:0.0:1788744799.811867:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451230464 00000100:00100000:0.0:1788744799.811924:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:0.0:1788744799.811934:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:13855:x1875634451230464:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788744799.812438:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:13855:x1875634451230464:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 503us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744799.812447:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:3.0:1788744799.820083:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744799.820262:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451230592 00000100:00100000:1.0:1788744799.820274:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451230592 00000100:00100000:1.0:1788744799.820340:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00100000:1.0:1788744799.820351:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:13855:x1875634451230592:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788744799.820644:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:13855:x1875634451230592:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 294us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744799.820652:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00100000:2.0:1788744799.824383:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744799.824502:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451230720 00000100:00100000:0.0:1788744799.824513:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451230720 00000100:00100000:0.0:1788744799.824574:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 101 00000100:00100000:0.0:1788744799.824584:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:13865:x1875634451230720:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744799.824856:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:13865:x1875634451230720:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 273us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744799.824865:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 101 00000100:00100000:3.0:1788744799.829078:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744799.829236:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451230848 00000100:00100000:2.0:1788744799.829246:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451230848 00000100:00100000:2.0:1788744799.829298:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 102 00000100:00100000:2.0:1788744799.829307:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:13865:x1875634451230848:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744799.829570:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:13865:x1875634451230848:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 263us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744799.829579:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 102 00000100:00100000:3.0:1788744799.832554:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744799.832701:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451230976 00000100:00100000:0.0:1788744799.832712:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451230976 00000100:00100000:0.0:1788744799.832768:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:0.0:1788744799.832779:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2358:x1875634451230976:12345-192.168.201.6@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788744799.832813:0:14366:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15@192.168.201.6@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:0.0:1788744799.832857:0:14366:0:(genops.c:1384:class_connect()) connect: client c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15, cookie 0x4b162761eb39332f 00000004:00100000:0.0:1788744799.832905:0:14366:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788744799.833045:0:14366:0:(import.c:65:import_set_state_nolock()) ffff93a104b50000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744799.833685:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:2358:x1875634451230976:12345-192.168.201.6@tcp:38:mount.lustre.0 Request processed in 905us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744799.833695:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:3.0:1788744799.851962:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744799.852077:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744799.852388:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451231104 00000100:00100000:0.0:1788744799.852400:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451231104 00000100:00100000:0.0:1788744799.852512:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451231232 00000100:00100000:0.0:1788744799.852516:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451231232 00000100:00100000:0.0:1788744799.852534:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788744799.852544:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+7:2362:x1875634451231104:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788744799.852578:0:14368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788744799.852667:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+7:2362:x1875634451231104:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 115us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744799.852675:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788744799.852693:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1788744799.852700:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:13855:x1875634451231232:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788744799.852711:0:14368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788744799.852734:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:13855:x1875634451231232:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 35us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744799.852740:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00080000:1.0:1788744799.853339:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744799.856966:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744799.857065:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451231360 00000100:00100000:0.0:1788744799.857075:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451231360 00000100:00100000:0.0:1788744799.857172:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1788744799.857183:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:13855:x1875634451231360:12345-192.168.201.6@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788744799.857275:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:13855:x1875634451231360:12345-192.168.201.6@tcp:40:mount.lustre.0 Request processed in 94us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744799.857302:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1788744799.870947:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744799.870996:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744799.871033:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744799.871307:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451231488 00000100:00100000:1.0:1788744799.871319:0:15050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451231488 00000100:00100000:1.0:1788744799.871368:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451231616 00000100:00100000:1.0:1788744799.871371:0:15050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451231616 00000100:00100000:1.0:1788744799.871394:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:1.0:1788744799.871402:0:15050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875634451231488:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788744799.871454:0:15050:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15@192.168.201.6@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:1.0:1788744799.871485:0:15050:0:(genops.c:1384:class_connect()) connect: client c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15, cookie 0x4b162761eb393336 00002000:00100000:1.0:1788744799.871496:0:15050:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15/ffff93a107940000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788744799.871508:0:15050:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788744799.871650:0:15050:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788744799.871688:0:15050:0:(import.c:65:import_set_state_nolock()) ffff93a107944000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744799.871754:0:15050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:2358:x1875634451231488:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 350us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744799.871762:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:1.0:1788744799.871778:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:1.0:1788744799.871784:0:15050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875634451231616:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788744799.871799:0:15050:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15@192.168.201.6@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:1.0:1788744799.871816:0:15050:0:(genops.c:1384:class_connect()) connect: client c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15, cookie 0x4b162761eb39333d 00002000:00100000:1.0:1788744799.871821:0:15050:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15/ffff93a107945800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788744799.871844:0:15050:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788744799.872028:0:15050:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788744799.872043:0:15050:0:(import.c:65:import_set_state_nolock()) ffff93a107941800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744799.872066:0:15050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:2358:x1875634451231616:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 280us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744799.872072:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:2.0:1788744799.872483:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451231744 00000100:00100000:2.0:1788744799.872489:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451231744 00000100:00100000:2.0:1788744799.872532:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:2.0:1788744799.872540:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:13855:x1875634451231744:12345-192.168.201.6@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788744799.872623:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788744799.872690:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:13855:x1875634451231744:12345-192.168.201.6@tcp:33:mount.lustre.0 Request processed in 150us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744799.872697:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:0.0:1788744800.033250:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744800.033451:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451231872 00000100:00100000:3.0:1788744800.033463:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451231872 00000100:00100000:3.0:1788744800.033535:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:3.0:1788744800.033546:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:13885:x1875634451231872:12345-192.168.201.6@tcp:101:mkdir.0 00010000:00010000:3.0:1788744800.033567:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744800.033605:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81a00/0x4b162761eb393344 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d552e7 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744800.033679:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39334b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744800.033693:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39334b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744800.033709:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39334b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744800.033749:0:14366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788744800.033753:0:14366:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744800.033775:0:14366:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39334b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744800.033802:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81a00/0x4b162761eb393344 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d552e7 expref: 8 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744800.033841:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39334b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d552e7 expref: 7 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744800.033850:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:3.0:1788744800.033853:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744800.033857:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80800, rc 0) 00000100:00100000:3.0:1788744800.033918:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+7:13885:x1875634451231872:12345-192.168.201.6@tcp:101:mkdir.0 Request processed in 373us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744800.033925:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00010000:00010000:3.0:1788744800.436464:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744800.564407:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475340416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744800.564479:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744800.564650:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475340416 00000100:00100000:3.0:1788744800.564660:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475340416 00000100:00100000:3.0:1788744800.564737:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744800.564756:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475340416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744800.564779:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744800.564832:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475340416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744800.564838:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788744800.564899:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744800.564992:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475340416:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788744800.651602:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15 00000001:00100000:2.0:1788744800.651763:0:6709:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 048fcf10-bca2-4fd1-9809-4e3b531d6735 00010000:00010000:3.0:1788744801.460389:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788744802.146217:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15 00000001:00100000:3.0:1788744802.147155:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 048fcf10-bca2-4fd1-9809-4e3b531d6735 00010000:00010000:1.0:1788744802.485001:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744802.613270:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744802.613295:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1069b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475340544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744802.613370:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744802.613477:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475340544 00000100:00100000:3.0:1788744802.613486:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475340544 00000100:00100000:3.0:1788744802.613562:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744802.613578:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475340544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744802.613622:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744802.613854:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475340544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 284us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744802.613861:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788744802.613928:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788744802.613949:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1069b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475340544:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788744802.614671:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744802.628780:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1069b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85c0995c-9591-4016-879e-a5185771e142:3307:1875634475340672:0@lo:400:kworker.0 00000100:00100000:2.0:1788744802.628855:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744802.628900:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1069b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475341184:0@lo:400:kworker.0 00000100:00100000:2.0:1788744802.628926:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744802.628969:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744802.628975:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1069b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475340800:0@lo:400:kworker.0 00000100:00100000:2.0:1788744802.628998:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744802.629029:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475341184 00000100:00100000:2.0:1788744802.629037:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475341184 00000100:00100000:2.0:1788744802.629094:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788744802.629103:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475341184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744802.629181:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475341184:12345-0@lo:400:kworker.0 Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744802.629188:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788744802.629216:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475340800 00000100:00100000:2.0:1788744802.629220:0:15050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475340800 00000100:00100000:2.0:1788744802.629256:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744802.629263:0:15050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475340800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744802.629294:0:15050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475340800:12345-0@lo:400:kworker.0 Request processed in 32us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744802.629299:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744802.629334:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1069b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475340800:0@lo:400:kworker.0 00000100:00100000:2.0:1788744802.629344:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1069b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475341184:0@lo:400:kworker.0 00000100:00100000:2.0:1788744802.629413:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1069b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634475341056:0@lo:400:kworker.0 00000100:00100000:2.0:1788744802.629437:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744802.629456:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744802.629463:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1069b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634475340928:0@lo:400:kworker.0 00000100:00100000:2.0:1788744802.629484:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744802.629506:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475341056 00000100:00100000:2.0:1788744802.629509:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475341056 00000100:00100000:2.0:1788744802.629538:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475340928 00000100:00100000:2.0:1788744802.629541:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475340928 00000100:00100000:2.0:1788744802.629739:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788744802.629745:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634475341056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744802.629782:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634475341056:12345-0@lo:400:kworker.0 Request processed in 36us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744802.629788:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788744802.629803:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788744802.629809:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634475340928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744802.629836:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634475340928:12345-0@lo:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744802.629842:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788744802.629872:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1069b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634475340928:0@lo:400:kworker.0 00000100:00100000:2.0:1788744802.629882:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1069b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634475341056:0@lo:400:kworker.0 00000100:00100000:2.0:1788744802.630083:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475340672 00000100:00100000:2.0:1788744802.630088:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475340672 00000100:00100000:2.0:1788744802.630115:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788744802.630396:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+19:3307:x1875634475340672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744802.630445:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+19:3307:x1875634475340672:12345-0@lo:400:kworker.0 Request processed in 323us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744802.630452:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788744802.630498:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1069b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85c0995c-9591-4016-879e-a5185771e142:3307:1875634475340672:0@lo:400:kworker.0 00000100:00080000:2.0:1788744802.630532:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744802.630537:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1788744802.671028:0:7638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15 00010000:00010000:3.0:1788744803.509421:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788744803.515977:0:16332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788744804.554333:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744805.296850:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744805.296956:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744805.297370:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451232000 00000100:00100000:3.0:1788744805.297382:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451232000 00000100:00100000:3.0:1788744805.297770:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 104 00000100:00100000:3.0:1788744805.297784:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:2361:x1875634451232000:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744805.297877:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:2361:x1875634451232000:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 97us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744805.297886:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 104 00000100:00100000:3.0:1788744805.297954:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744805.298274:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744805.298301:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744805.298337:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744805.298360:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744805.298383:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451232256 00000100:00100000:1.0:1788744805.298510:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451232128 00000100:00100000:1.0:1788744805.298517:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451232128 00000100:00100000:1.0:1788744805.298580:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451232512 00000100:00100000:1.0:1788744805.298584:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451232512 00000100:00100000:1.0:1788744805.298603:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:1.0:1788744805.298612:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:2362:x1875634451232128:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744805.298664:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:2362:x1875634451232128:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 54us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744805.298671:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:1.0:1788744805.298686:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1788744805.298692:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:2361:x1875634451232512:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744805.298718:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:2361:x1875634451232512:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744805.298723:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1788744805.298741:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451232384 00000100:00100000:1.0:1788744805.298746:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451232384 00000100:00100000:1.0:1788744805.298788:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451232640 00000100:00100000:1.0:1788744805.298791:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451232640 00000100:00100000:1.0:1788744805.298803:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451232768 00000100:00100000:1.0:1788744805.298805:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451232768 00000100:00100000:1.0:1788744805.298819:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1788744805.298825:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:2362:x1875634451232384:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744805.298854:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d568380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:2362:x1875634451232384:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 28us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744805.298860:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1788744805.298872:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1788744805.298878:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+5:2362:x1875634451232640:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744805.298901:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+5:2362:x1875634451232640:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 24us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744805.298906:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1788744805.298916:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1788744805.298922:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+5:2361:x1875634451232768:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744805.298944:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+5:2361:x1875634451232768:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 21us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744805.298949:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00080000:1.0:1788744805.298965:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744805.298969:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744805.298971:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744805.300003:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451232256 00000100:00100000:3.0:1788744805.300075:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:3.0:1788744805.300086:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:2361:x1875634451232256:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744805.300174:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:2361:x1875634451232256:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 90us (2219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744805.300180:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00080000:1.0:1788744805.300776:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788744805.556447:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744805.684580:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744805.684674:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d56a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475341312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744805.684762:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744805.690351:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475341312 00000100:00100000:3.0:1788744805.690384:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475341312 00000100:00100000:3.0:1788744805.690463:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744805.690476:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475341312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744805.690518:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744805.690625:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875634475341312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (5863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744805.690632:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744805.690705:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d56a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875634475341312:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788744805.690822:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788744806.581524:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788744807.035834:0:16481:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff79f1f2a0 20000000:00000080:2.0:1788744807.035856:0:16481:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93a23c12a000 uarg=0000000000000000 20000000:01000000:2.0:1788744807.035896:0:16481:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788744807.035901:0:16481:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788744807.035907:0:16481:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788744807.036992:0:16482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788744807.037586:0:16481:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788744807.042342:0:16481:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788744807.044347:0:16481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93a107e81a00/0x4b162761eb393352 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744807.044375:0:16481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a107e81e00/0x4b162761eb393049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb393042 expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744807.044384:0:16481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a2064f3400/0x4b162761eb393096 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb39308f expref: 18 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744807.044392:0:16481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3931d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb3931ca expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744807.044402:0:16481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a2048dc200/0x4b162761eb3932f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5525b expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744807.044409:0:16481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93a2048dd400/0x4b162761eb393328 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d552bd expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744807.044415:0:16481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93a107e81a00/0x4b162761eb393352 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744807.044477:0:16481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a2048dd400/0x4b162761eb393328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d552bd expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744807.044491:0:16481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93a2048dd400/0x4b162761eb393328 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d552bd expref: 12 pid: 14360 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744807.044801:0:16481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d56a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1875634475341440:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744807.045050:0:16481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a2048dc200/0x4b162761eb3932f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5525b expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744807.045060:0:16481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93a2048dc200/0x4b162761eb3932f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5525b expref: 12 pid: 14361 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744807.045069:0:16481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d569c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1875634475341568:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744807.045104:0:16481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3931d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb3931ca expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744807.045113:0:16481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3931d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb3931ca expref: 18 pid: 14361 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744807.045122:0:16481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c781c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1875634475341696:0@lo:104: 00000100:00100000:3.0:1788744807.045189:0:16481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788744807.045236:0:16481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a2064f3400/0x4b162761eb393096 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb39308f expref: 18 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744807.045243:0:16481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93a2064f3400/0x4b162761eb393096 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb39308f expref: 18 pid: 14359 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744807.045264:0:16481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d136680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1875634475341824:0@lo:104: 00000100:00100000:3.0:1788744807.045298:0:16481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788744807.045330:0:16481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93a107e81e00/0x4b162761eb393049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b162761eb393042 expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744807.045338:0:16481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93a107e81e00/0x4b162761eb393049 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b162761eb393042 expref: 18 pid: 14361 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744807.045347:0:16481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d134700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1875634475341952:0@lo:104: 00000100:00100000:3.0:1788744807.045372:0:16481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744807.045382:0:16481:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a20d114480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744807.045454:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788744807.045467:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475341696 00000100:00100000:2.0:1788744807.045473:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475341696 00000100:00100000:2.0:1788744807.045518:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475341824 00000100:00100000:2.0:1788744807.045521:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475341824 00000100:00100000:2.0:1788744807.045529:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475341952 00000100:00100000:2.0:1788744807.045538:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475341952 00000100:00100000:2.0:1788744807.045552:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744807.045559:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85c0995c-9591-4016-879e-a5185771e142+5:16481:x1875634475341696:12345-0@lo:104: 00010000:00010000:2.0:1788744807.045572:0:14350:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb3931ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb3931d1 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.045628:0:14350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744807.045634:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85c0995c-9591-4016-879e-a5185771e142+5:16481:x1875634475341696:12345-0@lo:104: Request processed in 75us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744807.045640:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744807.045659:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744807.045664:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85c0995c-9591-4016-879e-a5185771e142+4:16481:x1875634475341824:12345-0@lo:104: 00010000:00010000:2.0:1788744807.045671:0:14350:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb39308f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb393096 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.045699:0:14350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788744807.045710:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85c0995c-9591-4016-879e-a5185771e142+4:16481:x1875634475341824:12345-0@lo:104: Request processed in 45us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744807.045727:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744807.045740:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744807.045745:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a104b93850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85c0995c-9591-4016-879e-a5185771e142+3:16481:x1875634475341952:12345-0@lo:104: 00010000:00010000:2.0:1788744807.045752:0:14350:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393042 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb393049 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.045782:0:14350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788744807.045786:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a104b93850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:85c0995c-9591-4016-879e-a5185771e142+3:16481:x1875634475341952:12345-0@lo:104: Request processed in 42us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744807.045791:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788744807.045824:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788744807.045830:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb3931ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb3931d1 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.045836:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80a00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:2.0:1788744807.045840:0:15500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb3931ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb3931d1 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.045849:0:15500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb3931ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb3931d1 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744807.045856:0:15500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb3931ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb3931d1 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744807.045862:0:15500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788744807.045891:0:15500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb3931ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb3931d1 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.045907:0:15500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744807.045926:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb3931ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb3931d1 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.045934:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a107e80a00/0x4b162761eb3931ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb3931d1 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.045948:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744807.045951:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb39308f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb393096 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.045956:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23d17e200 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:2.0:1788744807.045958:0:15500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb39308f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb393096 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.045964:0:15500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb39308f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb393096 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744807.045970:0:15500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb39308f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb393096 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744807.045975:0:15500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788744807.045988:0:15500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb39308f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb393096 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.045994:0:15500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744807.046000:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb39308f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb393096 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.046006:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a23d17e200/0x4b162761eb39308f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb393096 expref: -99 pid: 15047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.046022:0:15500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744807.046026:0:15500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393042 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b162761eb393049 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.046030:0:15500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2e00 already unused, calling callback (ffffffffc1c2dc20) 10000000:00010000:2.0:1788744807.046033:0:15500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393042 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b162761eb393049 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.046040:0:15500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b162761eb393049 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744807.046045:0:15500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b162761eb393049 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744807.046050:0:15500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788744807.046063:0:15500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393042 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb393049 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.046068:0:15500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744807.046084:0:15500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393042 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb393049 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.046091:0:15500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393042 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b162761eb393049 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.046103:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744807.046105:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744807.046106:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744807.046113:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744807.046124:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744807.046172:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85c0995c-9591-4016-879e-a5185771e142:3309:1875634475342080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744807.046204:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744807.046231:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744807.046237:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85c0995c-9591-4016-879e-a5185771e142:3309:1875634475342208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744807.046255:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744807.046293:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85c0995c-9591-4016-879e-a5185771e142:3307:1875634475342336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744807.046316:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744807.046345:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475342080 00000100:00100000:2.0:1788744807.046349:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475342080 00010000:00010000:2.0:1788744807.046368:0:14351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3931d1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb3931ca expref: 19 pid: 14361 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744807.046383:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475342208 00000100:00100000:2.0:1788744807.046385:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475342208 00010000:00010000:2.0:1788744807.046398:0:14351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a2064f3400/0x4b162761eb393096 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb39308f expref: 20 pid: 14359 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744807.046409:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475342336 00000100:00100000:2.0:1788744807.046412:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475342336 00010000:00010000:2.0:1788744807.046421:0:14351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a107e81e00/0x4b162761eb393049 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb393042 expref: 21 pid: 14361 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744807.046432:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744807.046437:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85c0995c-9591-4016-879e-a5185771e142+21:3309:x1875634475342080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744807.046447:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744807.046452:0:14351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3931d1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb3931ca expref: 21 pid: 14361 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.046473:0:14351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3931d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb3931ca expref: 21 pid: 14361 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.046487:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744807.046516:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85c0995c-9591-4016-879e-a5185771e142+21:3309:x1875634475342080:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744807.046523:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744807.046539:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744807.046545:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85c0995c-9591-4016-879e-a5185771e142+20:3309:x1875634475342208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744807.046552:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744807.046556:0:14351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a2064f3400/0x4b162761eb393096 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb39308f expref: 20 pid: 14359 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.046563:0:14351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a2064f3400/0x4b162761eb393096 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb39308f expref: 20 pid: 14359 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.046572:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744807.046590:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85c0995c-9591-4016-879e-a5185771e142+20:3309:x1875634475342208:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744807.046595:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744807.046606:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744807.046610:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a239431050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85c0995c-9591-4016-879e-a5185771e142+19:3307:x1875634475342336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744807.046615:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744807.046619:0:14351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a107e81e00/0x4b162761eb393049 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b162761eb393042 expref: 19 pid: 14361 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.046626:0:14351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a107e81e00/0x4b162761eb393049 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b162761eb393042 expref: 19 pid: 14361 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.046640:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744807.046663:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a239431050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85c0995c-9591-4016-879e-a5185771e142+19:3307:x1875634475342336:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744807.046669:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744807.046725:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:85c0995c-9591-4016-879e-a5185771e142:3307:1875634475342336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744807.046746:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85c0995c-9591-4016-879e-a5185771e142:3309:1875634475342208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744807.046753:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85c0995c-9591-4016-879e-a5185771e142:3309:1875634475342080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744807.046976:0:16481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a23d17fc00/0x4b162761eb3931d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb3931ca expref: 18 pid: 14361 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744807.046991:0:16481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c781c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1875634475341696:0@lo:104: 00010000:00010000:3.0:1788744807.047002:0:16481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2064f3400/0x4b162761eb393096 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb39308f expref: 17 pid: 14359 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744807.047010:0:16481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d136680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1875634475341824:0@lo:104: 00010000:00010000:3.0:1788744807.047019:0:16481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a107e81e00/0x4b162761eb393049 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b162761eb393042 expref: 16 pid: 14361 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744807.047026:0:16481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d134700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1875634475341952:0@lo:104: 00000100:00100000:2.0:1788744807.052839:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744807.052883:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744807.053043:0:16481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d56a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1875634475341440:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788744807.053057:0:16481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d569c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16481:1875634475341568:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788744807.053108:0:16481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93a107e81a00/0x4b162761eb393352 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744807.053241:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451232896 00000100:00100000:0.0:1788744807.053249:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451232896 00010000:00010000:0.0:1788744807.053299:0:14351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a2048dd400/0x4b162761eb393328 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d552bd expref: 13 pid: 14360 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744807.053332:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451233024 00000100:00100000:0.0:1788744807.053335:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451233024 00010000:00010000:0.0:1788744807.053347:0:14351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93a2048dc200/0x4b162761eb3932f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5525b expref: 14 pid: 14361 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744807.053363:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:0.0:1788744807.053372:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+14:2359:x1875634451232896:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744807.053388:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744807.053393:0:14351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a2048dd400/0x4b162761eb393328 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d552bd expref: 14 pid: 14360 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744807.053415:0:14351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a2048dd400/0x4b162761eb393328 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d552bd expref: 14 pid: 14360 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744807.053433:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2048dd400/0x4b162761eb393328 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d552bd expref: 14 pid: 14360 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744807.053451:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744807.053508:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:2359:x1875634451232896:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 136us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744807.053516:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:0.0:1788744807.053546:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:0.0:1788744807.053553:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+12:2359:x1875634451233024:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744807.053560:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744807.053564:0:14351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93a2048dc200/0x4b162761eb3932f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5525b expref: 12 pid: 14361 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744807.053572:0:14351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93a2048dc200/0x4b162761eb3932f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5525b expref: 12 pid: 14361 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744807.053581:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a2048dc200/0x4b162761eb3932f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5525b expref: 12 pid: 14361 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744807.053592:0:14351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93a107e81a00/0x4b162761eb393352 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744807.053600:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e81a00/0x4b162761eb393352 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744807.053623:0:14351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a107e81a00/0x4b162761eb393352 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744807.053630:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93a107e81a00/0x4b162761eb393352 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744807.053637:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93a107e81a00/0x4b162761eb393352 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744807.053644:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93a107e81a00/0x4b162761eb393352 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744807.053649:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e81a00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744807.053653:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93a107e81a00/0x4b162761eb393352 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744807.053660:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93a107e81a00/0x4b162761eb393352 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744807.053671:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93a107e81a00/0x4b162761eb393352 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744807.053678:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744807.053697:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+11:2359:x1875634451233024:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 145us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744807.053703:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00010000:00010000:3.0:1788744807.053955:0:16481:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93a107e81a00/0x4b162761eb393352 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744807.053964:0:16481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93a107e81a00/0x4b162761eb393352 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744807.053969:0:16481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93a107e81a00/0x4b162761eb393352 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744807.604879:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744807.732981:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1069b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475342464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744807.733060:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744807.733514:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475342464 00000100:00100000:0.0:1788744807.733529:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475342464 00000100:00100000:0.0:1788744807.733603:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744807.733613:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475342464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744807.733663:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744807.733709:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475342464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744807.733716:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788744807.733837:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744807.733875:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1069b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475342464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744807.734701:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475342848:0@lo:400:kworker.0 00000100:00100000:3.0:1788744807.734744:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744807.734772:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744807.734778:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475342976:0@lo:400:kworker.0 00000100:00100000:3.0:1788744807.734797:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744807.734826:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475342848 00000100:00100000:3.0:1788744807.734831:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475342848 00000100:00100000:3.0:1788744807.734867:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475342976 00000100:00100000:3.0:1788744807.734871:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475342976 00000100:00100000:3.0:1788744807.734892:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788744807.734900:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475342848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744807.734954:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875634475342848:12345-0@lo:400:kworker.0 Request processed in 55us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744807.734961:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788744807.734979:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788744807.734987:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475342976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744807.735014:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475342976:12345-0@lo:400:kworker.0 Request processed in 30us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744807.735032:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788744807.735066:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475342976:0@lo:400:kworker.0 00000100:00100000:2.0:1788744807.735221:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85c0995c-9591-4016-879e-a5185771e142:3309:1875634475342592:0@lo:400:kworker.0 00000100:00100000:2.0:1788744807.735253:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744807.735291:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634475343104:0@lo:400:kworker.0 00000100:00100000:2.0:1788744807.735314:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744807.735333:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744807.735338:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475342720:0@lo:400:kworker.0 00000100:00100000:2.0:1788744807.735362:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744807.735392:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475342592 00000100:00100000:2.0:1788744807.735397:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475342592 00000100:00100000:2.0:1788744807.735442:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788744807.735449:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+16:3309:x1875634475342592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744807.735485:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+16:3309:x1875634475342592:12345-0@lo:400:kworker.0 Request processed in 36us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744807.735492:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788744807.735537:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475342720 00000100:00100000:2.0:1788744807.735541:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475342720 00000100:00100000:2.0:1788744807.735571:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788744807.735579:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475342720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744807.735609:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475342720:12345-0@lo:400:kworker.0 Request processed in 32us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744807.735615:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788744807.735640:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744807.735644:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744807.735661:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475342720:0@lo:400:kworker.0 00000100:00100000:2.0:1788744807.735670:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:85c0995c-9591-4016-879e-a5185771e142:3309:1875634475342592:0@lo:400:kworker.0 00000100:00100000:2.0:1788744807.735691:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475343104 00000100:00100000:2.0:1788744807.735695:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475343104 00000100:00100000:2.0:1788744807.735722:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788744807.735728:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875634475343104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744807.735759:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875634475343104:12345-0@lo:400:kworker.0 Request processed in 32us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744807.735765:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788744807.735779:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744807.735792:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634475343104:0@lo:400:kworker.0 00000100:00100000:3.0:1788744807.735958:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875634475342848:0@lo:400:kworker.0 00000040:00080000:1.0:1788744807.928155:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788744808.630401:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744808.805898:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744808.805989:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451233152 00000100:00100000:2.0:1788744808.805999:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451233152 00000100:00100000:2.0:1788744808.806058:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 106 00000100:00100000:2.0:1788744808.806069:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+11:13740:x1875634451233152:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744808.806086:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744808.806107:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2064f3800/0x4b162761eb393359 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d552ee expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744808.806164:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2064f3800/0x4b162761eb393359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d552ee expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744808.806175:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2064f3800/0x4b162761eb393359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d552ee expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744808.806185:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3800, rc 0) 00000100:00100000:2.0:1788744808.806260:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+12:13740:x1875634451233152:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 184us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744808.806268:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 106 00000100:00100000:0.0:1788744808.809467:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744808.809699:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451233280 00000100:00100000:2.0:1788744808.809711:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451233280 00000100:00100000:2.0:1788744808.809774:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 107 00000100:00100000:2.0:1788744808.809783:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+12:13740:x1875634451233280:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744808.810082:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+12:13740:x1875634451233280:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 299us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744808.810091:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 107 00000100:00100000:0.0:1788744808.813394:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744808.813604:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451233408 00000100:00100000:3.0:1788744808.813614:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451233408 00000100:00100000:3.0:1788744808.813672:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 108 00000100:00100000:3.0:1788744808.813683:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+12:13740:x1875634451233408:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744808.813913:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+12:13740:x1875634451233408:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 232us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744808.813921:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 108 00000100:00100000:3.0:1788744808.832340:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744808.832573:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451233536 00000100:00100000:1.0:1788744808.832584:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451233536 00000100:00100000:1.0:1788744808.832649:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 109 00000100:00100000:1.0:1788744808.832659:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+12:13740:x1875634451233536:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744808.832675:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744808.832822:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a210598200/0x4b162761eb393360 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x786e03e382d552f5 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744808.832854:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a210598200/0x4b162761eb393360 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d552f5 expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744808.833289:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a210598200/0x4b162761eb393360 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d552f5 expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744808.833300:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a210598200, rc 0) 00000100:00100000:1.0:1788744808.833411:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:13740:x1875634451233536:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 752us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744808.833418:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 109 00000100:00100000:3.0:1788744808.837636:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744808.837713:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451233664 00000100:00100000:1.0:1788744808.837721:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451233664 00000100:00100000:1.0:1788744808.837773:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 110 00000100:00100000:1.0:1788744808.837783:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:13740:x1875634451233664:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744808.843224:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:13740:x1875634451233664:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 5425us (5582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744808.843242:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 110 00000100:00100000:3.0:1788744808.855649:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744808.855744:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451233792 00000100:00100000:1.0:1788744808.855767:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451233792 00000100:00100000:1.0:1788744808.855829:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 111 00000100:00100000:1.0:1788744808.855839:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:13740:x1875634451233792:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744808.856082:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:13740:x1875634451233792:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 243us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744808.856090:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 111 10000000:01000000:2.0:1788744808.886202:0:14363:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788744808.886210:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a20653f800 from 10 10000000:01000000:2.0:1788744808.886217:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744808.886283:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393367 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744808.886295:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393367 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744808.886308:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393367 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744808.886336:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475343232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744808.886409:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744808.886460:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220495480 going to sleep for 11 seconds 00000100:00100000:3.0:1788744808.886536:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475343232 00000100:00100000:3.0:1788744808.886544:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475343232 00000100:00100000:3.0:1788744808.886601:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788744808.886612:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+16:14363:x1875634475343232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744808.886626:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744808.886640:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a107e80e00/0x4b162761eb39336e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb393367 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744808.886664:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a107e80e00/0x4b162761eb39336e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb393367 expref: 17 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744808.886674:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a107e80e00/0x4b162761eb39336e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb393367 expref: 17 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744808.886691:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a107e80e00, rc 0) 00000100:00100000:3.0:1788744808.886733:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+17:14363:x1875634475343232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744808.886811:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788744808.886913:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475343232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744808.886928:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393367 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39336e expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744808.886938:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393367 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb39336e expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744808.886991:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475343360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744808.887018:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744808.887041:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220495480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744808.887574:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475343360 00000100:00100000:0.0:1788744808.887582:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475343360 00000100:00100000:0.0:1788744808.887628:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788744808.887638:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+17:14363:x1875634475343360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744808.888166:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+17:14363:x1875634475343360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 529us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744808.888176:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788744808.888194:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475343360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744808.888237:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475343488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744808.888291:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744808.888324:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220495480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744808.888340:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475343488 00000100:00100000:2.0:1788744808.888352:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475343488 00000100:00100000:2.0:1788744808.888378:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788744808.888384:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+17:14363:x1875634475343488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744808.888524:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+17:14363:x1875634475343488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744808.888531:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788744808.888572:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475343488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788744808.893320:0:16556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788744808.893407:0:14363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788744808.893424:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788744808.893438:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393367 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39336e expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744808.893452:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a2064f2e00/0x4b162761eb393367 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39336e expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744808.893466:0:14363:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788744808.893468:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a205178000 from 10 10000000:01000000:2.0:1788744808.893471:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744808.893512:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2064f3400/0x4b162761eb393375 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744808.893521:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a2064f3400/0x4b162761eb393375 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744808.893531:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a2064f3400/0x4b162761eb393375 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744808.893555:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475343616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744808.893635:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744808.893674:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204849f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744808.895194:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475343616 00000100:00100000:2.0:1788744808.895206:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475343616 00000100:00100000:2.0:1788744808.895272:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788744808.895282:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+17:14363:x1875634475343616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744808.895300:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744808.895317:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2064f3e00/0x4b162761eb39337c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb393375 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744808.895345:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2064f3e00/0x4b162761eb39337c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb393375 expref: 18 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744808.895355:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2064f3e00/0x4b162761eb39337c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb393375 expref: 18 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744808.895364:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3e00, rc 0) 00000100:00100000:2.0:1788744808.895438:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+18:14363:x1875634475343616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744808.895444:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788744808.895656:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475343616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744808.895674:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a2064f3400/0x4b162761eb393375 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39337c expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744808.895683:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a2064f3400/0x4b162761eb393375 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb39337c expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744808.895758:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d356d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475343744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744808.895791:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744808.895817:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a206784300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744808.895914:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475343744 00000100:00100000:2.0:1788744808.895920:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475343744 00000100:00100000:2.0:1788744808.895951:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788744808.895958:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+18:14363:x1875634475343744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744808.896271:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+18:14363:x1875634475343744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744808.896278:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788744808.896313:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d356d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475343744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744808.896354:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c9b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475343872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744808.896390:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744808.896406:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220495480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744808.896432:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475343872 00000100:00100000:2.0:1788744808.896436:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475343872 00000100:00100000:2.0:1788744808.896454:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788744808.896460:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+18:14363:x1875634475343872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744808.896607:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+18:14363:x1875634475343872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744808.896614:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788744808.896650:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c9b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475343872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788744808.897711:0:16557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788744808.898712:0:14363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788744808.898804:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788744808.898817:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a2064f3400/0x4b162761eb393375 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39337c expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744808.898829:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a2064f3400/0x4b162761eb393375 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39337c expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744808.898841:0:14363:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788744808.898844:0:14363:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93a23bd31800 from 10 10000000:01000000:3.0:1788744808.898847:0:14363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788744808.898884:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81a00/0x4b162761eb393383 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744808.898892:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff93a107e81a00/0x4b162761eb393383 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744808.898903:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff93a107e81a00/0x4b162761eb393383 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744808.898925:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d137100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475344000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744808.898985:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744808.899064:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204f03540 going to sleep for 11 seconds 00000100:00100000:2.0:1788744808.899325:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475344000 00000100:00100000:2.0:1788744808.899333:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475344000 00000100:00100000:2.0:1788744808.899382:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788744808.899392:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a239459c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+18:14363:x1875634475344000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744808.899404:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744808.899424:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93a2064f3a00/0x4b162761eb39338a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b162761eb393383 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744808.899447:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93a2064f3a00/0x4b162761eb39338a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b162761eb393383 expref: 19 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744808.899459:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93a2064f3a00/0x4b162761eb39338a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b162761eb393383 expref: 19 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744808.899468:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3a00, rc 0) 00000100:00100000:2.0:1788744808.899522:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a239459c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+19:14363:x1875634475344000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744808.899529:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788744808.899837:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d137100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475344000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744808.899857:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff93a107e81a00/0x4b162761eb393383 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39338a expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744808.899866:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff93a107e81a00/0x4b162761eb393383 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b162761eb39338a expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744808.899917:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d137100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475344128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744808.899945:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744808.899976:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204f03540 going to sleep for 11 seconds 00000100:00100000:2.0:1788744808.900038:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475344128 00000100:00100000:2.0:1788744808.900042:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475344128 00000100:00100000:2.0:1788744808.900080:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788744808.900088:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a239458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+19:14363:x1875634475344128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744808.900906:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a239458c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85c0995c-9591-4016-879e-a5185771e142+19:14363:x1875634475344128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 815us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744808.900915:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788744808.901035:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d137100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475344128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744808.901091:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d356d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475344256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744808.901158:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744808.901187:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a206784480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744808.901306:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475344256 00000100:00100000:2.0:1788744808.901313:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475344256 00000100:00100000:2.0:1788744808.901343:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788744808.901350:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+19:14363:x1875634475344256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744808.901514:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85c0995c-9591-4016-879e-a5185771e142+19:14363:x1875634475344256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744808.901521:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788744808.901561:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d356d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:85c0995c-9591-4016-879e-a5185771e142:14363:1875634475344256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788744808.902597:0:16558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788744808.903504:0:14363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788744808.903539:0:14363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788744808.903551:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff93a107e81a00/0x4b162761eb393383 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39338a expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744808.903564:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff93a107e81a00/0x4b162761eb393383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b162761eb39338a expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744809.656820:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744810.419018:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744810.419075:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744810.419219:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744810.419280:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744810.419302:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744810.419325:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744810.419351:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744810.419398:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451234048 00000100:00100000:2.0:1788744810.419410:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451234048 00000100:00100000:2.0:1788744810.419482:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451234432 00000100:00100000:2.0:1788744810.419486:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451234432 00000100:00100000:2.0:1788744810.419507:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:2.0:1788744810.419527:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:2360:x1875634451234048:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744810.419610:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:2360:x1875634451234048:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 85us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744810.419618:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:0.0:1788744810.419727:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451234176 00000100:00100000:0.0:1788744810.419731:0:15050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451234176 00000100:00100000:0.0:1788744810.419755:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451234688 00000100:00100000:0.0:1788744810.419758:0:15050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451234688 00000100:00100000:0.0:1788744810.419770:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451234304 00000100:00100000:0.0:1788744810.419772:0:15050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451234304 00000100:00100000:0.0:1788744810.419782:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451234560 00000100:00100000:0.0:1788744810.419784:0:15050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451234560 00000100:00100000:0.0:1788744810.419796:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788744810.419802:0:15050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:2359:x1875634451234176:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744810.419831:0:15050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:2359:x1875634451234176:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 29us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744810.419837:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788744810.419990:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1788744810.419998:0:15050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+5:2359:x1875634451234688:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744810.420029:0:15050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+5:2359:x1875634451234688:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 31us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744810.420035:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1788744810.420048:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1788744810.420054:0:15050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:2360:x1875634451234304:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744810.420091:0:15050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:2360:x1875634451234304:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 36us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744810.420097:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1788744810.420109:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:0.0:1788744810.420116:0:15050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+5:2360:x1875634451234560:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788744810.420167:0:15050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+5:2360:x1875634451234560:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 51us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744810.420174:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00080000:0.0:1788744810.420239:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744810.420244:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744810.420246:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744810.422383:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:2.0:1788744810.422404:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c9b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:2359:x1875634451234432:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744810.422491:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c9b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:2359:x1875634451234432:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 94us (3209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744810.422499:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:1.0:1788744810.429669:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451233920 00000100:00100000:1.0:1788744810.429684:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451233920 00000100:00100000:1.0:1788744810.429762:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:1.0:1788744810.429773:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:2359:x1875634451233920:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788744810.429861:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:2359:x1875634451233920:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 89us (10785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744810.430268:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 121 00010000:00010000:2.0:1788744810.680144:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744810.805029:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744810.805055:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475344384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744810.805147:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744810.806698:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475344384 00000100:00100000:0.0:1788744810.806712:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475344384 00000100:00100000:0.0:1788744810.806800:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788744810.806809:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475344384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744810.806849:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744810.806927:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475344384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744810.806952:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788744810.807108:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744810.807243:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475344384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744810.814766:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744810.814927:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451234816 00000100:00100000:0.0:1788744810.814938:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451234816 00000100:00100000:0.0:1788744810.815001:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:0.0:1788744810.815011:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:14395:x1875634451234816:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744810.815033:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744810.815069:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048ddc00/0x4b162761eb393391 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d552fc expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815164:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393398 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815181:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393398 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815195:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393398 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815210:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dca00/0x4b162761eb39339f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815229:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dca00/0x4b162761eb39339f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815236:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dca00/0x4b162761eb39339f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815570:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc400/0x4b162761eb3933a6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815592:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc400/0x4b162761eb3933a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815600:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc400/0x4b162761eb3933a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744810.815627:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788744810.815631:0:14367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744810.815791:0:14367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc400/0x4b162761eb3933a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815803:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393398 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815809:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393398 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815815:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393398 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815821:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2048dd000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744810.815825:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393398 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815831:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393398 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815844:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:0.0:1788744810.815846:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744810.815851:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393398 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815866:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393398 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815879:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dca00/0x4b162761eb39339f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815885:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dca00/0x4b162761eb39339f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815890:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dca00/0x4b162761eb39339f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815895:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2048dca00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744810.815898:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dca00/0x4b162761eb39339f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815904:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dca00/0x4b162761eb39339f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815912:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93a203bf5a00) 00010000:00010000:0.0:1788744810.815914:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744810.815917:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dca00/0x4b162761eb39339f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815922:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dca00/0x4b162761eb39339f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815954:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048ddc00/0x4b162761eb393391 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d552fc expref: 8 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815978:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc400/0x4b162761eb3933a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d552fc expref: 7 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.815985:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93a203bf5300) 00010000:00010000:0.0:1788744810.815987:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744810.815989:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2048dc400, rc 0) 00000100:00100000:0.0:1788744810.816056:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+7:14395:x1875634451234816:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1045us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744810.816064:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:0.0:1788744810.820902:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744810.821936:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451235072 00000100:00100000:3.0:1788744810.821948:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451235072 00000100:00100000:3.0:1788744810.822020:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1788744810.822033:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+7:14395:x1875634451235072:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744810.822064:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744810.822085:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81e00/0x4b162761eb3933ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55303 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.822182:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80a00/0x4b162761eb3933b4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.822199:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80a00/0x4b162761eb3933b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.822238:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80a00/0x4b162761eb3933b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.822471:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.822483:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.822492:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.823022:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb3933c2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.823035:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb3933c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.826467:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb3933c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744810.826491:0:14366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788744810.828425:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80a00/0x4b162761eb3933b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.828443:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80a00/0x4b162761eb3933b4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.828450:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80a00/0x4b162761eb3933b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.828455:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a107e80a00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744810.828475:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80a00/0x4b162761eb3933b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.828484:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80a00/0x4b162761eb3933b4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.828500:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93a203bf5300) 00010000:00010000:3.0:1788744810.828504:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744810.828509:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80a00/0x4b162761eb3933b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.829389:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80a00/0x4b162761eb3933b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.829412:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.829419:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933bb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.829426:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.829431:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b600 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744810.829435:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.829442:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933bb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.829453:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93a21a9ae000) 00010000:00010000:3.0:1788744810.829456:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744810.829471:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933bb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.829477:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933bb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.832848:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e81e00/0x4b162761eb3933ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55303 expref: 10 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.832879:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ba00/0x4b162761eb3933c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55303 expref: 9 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.832889:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93a21a9aec00) 00010000:00010000:3.0:1788744810.832892:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744810.832896:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051ba00, rc 0) 00000100:00100000:3.0:1788744810.833031:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+9:14395:x1875634451235072:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 11000us (12137us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788744810.833052:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1788744810.851013:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744810.851204:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451235200 00000100:00100000:2.0:1788744810.851224:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451235200 00000100:00100000:2.0:1788744810.851298:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:2.0:1788744810.851310:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+9:14395:x1875634451235200:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788744810.851427:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+9:14395:x1875634451235200:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 Request processed in 119us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744810.851450:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:2.0:1788744810.916030:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744810.916621:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451235328 00000100:00100000:3.0:1788744810.916633:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451235328 00000100:00100000:3.0:1788744810.916718:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:3.0:1788744810.916728:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+9:14401:x1875634451235328:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788744810.916750:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744810.916773:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5530a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.916850:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb3933d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.916884:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb3933d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.916897:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb3933d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.916914:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb3933de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.916921:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb3933de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.916927:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb3933de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917198:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb3933d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917207:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb3933d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917247:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb3933d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917254:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744810.917258:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb3933d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917266:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb3933d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917278:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:3.0:1788744810.917288:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744810.917295:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb3933d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917302:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb3933d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917322:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb3933de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917328:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb3933de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917334:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb3933de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917339:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051ac00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744810.917342:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb3933de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917348:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb3933de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917355:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744810.917358:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744810.917361:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb3933de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917366:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb3933de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917413:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5530a expref: 10 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917432:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:3.0:1788744810.917434:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744810.917438:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5530a expref: 10 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744810.917927:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051b600, rc 0) 00000100:00100000:3.0:1788744810.917998:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+9:14401:x1875634451235328:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1270us (1980us total) trans 0 rc 301/301 00000100:00100000:3.0:1788744810.918006:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:1.0:1788744810.926867:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744810.927010:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451235456 00000100:00100000:0.0:1788744810.927021:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451235456 00000100:00100000:0.0:1788744810.927095:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:0.0:1788744810.927106:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:048fcf10-bca2-4fd1-9809-4e3b531d6735+9:14401:x1875634451235456:12345-192.168.201.6@tcp:700:lfs.0 00000100:00100000:1.0:1788744810.927968:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:048fcf10-bca2-4fd1-9809-4e3b531d6735+9:14401:x1875634451235456:12345-192.168.201.6@tcp:700:lfs.0 Request processed in 857us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744810.927982:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:0.0:1788744810.931596:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744810.931720:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451235712 00000100:00100000:2.0:1788744810.931732:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451235712 00000100:00100000:2.0:1788744810.931852:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:2.0:1788744810.931864:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+9:14401:x1875634451235712:12345-192.168.201.6@tcp:36:lfs.0 00010000:00010000:2.0:1788744810.931933:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744810.931961:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb393313 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55285 expref: 9 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744810.931982:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:2.0:1788744810.931986:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744810.932718:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3933e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744810.932736:0:14367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39334b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d552e7 expref: 5 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744810.932745:0:14367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3933e5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744810.932836:0:14367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39334b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d552e7 expref: 5 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744810.932851:0:14367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39334b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d552e7 expref: 5 pid: 14366 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744810.932866:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c780000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14367:1875634475344512:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744810.932961:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23f8610c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744810.938329:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c780000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14367:1875634475344512:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788744810.938362:0:14367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3933e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744810.938838:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744810.939203:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451235840 00000100:00100000:0.0:1788744810.939222:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451235840 00010000:00010000:0.0:1788744810.939265:0:14351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39334b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d552e7 expref: 6 pid: 14366 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744810.939416:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:0.0:1788744810.939427:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:2359:x1875634451235840:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744810.939459:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744810.939467:0:14351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39334b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d552e7 expref: 6 pid: 14366 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.939480:0:14351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39334b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d552e7 expref: 6 pid: 14366 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.939503:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a107e80800/0x4b162761eb39334b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d552e7 expref: 6 pid: 14366 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.939532:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:0.0:1788744810.939538:0:14351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3933e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.939547:0:14351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3933e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.939553:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3933e5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.939588:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744810.939802:0:14367:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3933e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744810.939811:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3933e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744810.939839:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a210599000/0x4b162761eb3933ec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744810.939850:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a210599000/0x4b162761eb3933ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744810.939858:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a210599000/0x4b162761eb3933ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744810.939954:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+5:2359:x1875634451235840:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 527us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744810.939962:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000004:00200000:1.0:1788744810.941604:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788744810.941632:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3933e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744810.941649:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3933e5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744810.941657:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3933e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744810.941674:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744810.941678:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3933e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744810.941686:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3933e5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744810.941702:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a209e2ec00) 00010000:00010000:1.0:1788744810.941705:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744810.941710:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3933e5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744810.941716:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3933e5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744810.941737:0:14367:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000cb01cbac reply state 000000003d6f0e61 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93a210599000/0x4b162761eb3933ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744810.941746:0:14367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788744810.941827:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+10:14401:x1875634451235712:12345-192.168.201.6@tcp:36:lfs.0 Request processed in 9964us (10239us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788744810.941836:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00010000:00010000:0.0:1788744810.945862:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a210599000/0x4b162761eb3933ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.945880:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a210599000/0x4b162761eb3933ec lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.945904:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a210599000/0x4b162761eb3933ec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.945911:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a210599000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744810.945916:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a210599000/0x4b162761eb3933ec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.945925:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a210599000/0x4b162761eb3933ec lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.945939:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93a209cf4d00) 00010000:00010000:0.0:1788744810.945943:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744810.945948:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a210599000/0x4b162761eb3933ec lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744810.945955:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a210599000/0x4b162761eb3933ec lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744810.997595:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788744811.048259:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744811.048442:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451235968 00000100:00100000:3.0:1788744811.048454:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451235968 00000100:00100000:3.0:1788744811.048538:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:3.0:1788744811.048550:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+9:14409:x1875634451235968:12345-192.168.201.6@tcp:101:lctl.0 00010000:00010000:3.0:1788744811.048579:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744811.048603:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb3933f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55311 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.048686:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.048704:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.048716:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744811.048771:0:14366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788744811.048774:0:14366:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744811.048810:0:14366:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.048834:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb3933f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55311 expref: 11 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.048854:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b600/0x4b162761eb3933fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55311 expref: 10 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.048863:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744811.048866:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744811.048869:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051b600, rc 0) 00000100:00100000:3.0:1788744811.048992:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+10:14409:x1875634451235968:12345-192.168.201.6@tcp:101:lctl.0 Request processed in 444us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744811.048999:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:3.0:1788744811.080057:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744811.080117:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451236096 00000100:00100000:1.0:1788744811.080158:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451236096 00000100:00100000:1.0:1788744811.080221:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:1.0:1788744811.080230:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+5:14410:x1875634451236096:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788744811.080248:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744811.080267:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a210598400/0x4b162761eb393401 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55318 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.080349:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a210599e00/0x4b162761eb393408 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.080361:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a210599e00/0x4b162761eb393408 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.080370:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a210599e00/0x4b162761eb393408 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744811.080399:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788744811.080403:0:14367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744811.080421:0:14367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a210599e00/0x4b162761eb393408 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.080444:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a210598400/0x4b162761eb393401 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55318 expref: 7 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.080462:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a210599e00/0x4b162761eb393408 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55318 expref: 6 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.080470:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:1.0:1788744811.080473:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744811.080477:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a210599e00, rc 0) 00000100:00100000:1.0:1788744811.080543:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:14410:x1875634451236096:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 314us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744811.080551:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:1.0:1788744811.084422:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744811.084761:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451236224 00000100:00100000:0.0:1788744811.084771:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451236224 00000100:00100000:0.0:1788744811.084827:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:0.0:1788744811.084837:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:14410:x1875634451236224:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788744811.084861:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744811.084882:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb39340f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5531f expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.084939:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393416 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.084968:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393416 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.084978:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393416 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.084988:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb39341d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.084992:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb39341d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.084996:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb39341d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085083:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393424 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085088:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393424 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085092:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393424 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744811.085116:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788744811.085118:0:14368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744811.085173:0:14368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393424 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085185:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393416 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085201:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393416 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085206:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393416 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085222:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2048dd200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744811.085225:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393416 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085231:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393416 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085240:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:0.0:1788744811.085242:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744811.085245:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393416 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085249:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393416 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085260:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb39341d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085263:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb39341d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085267:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb39341d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085270:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2048dde00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744811.085276:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb39341d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085280:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb39341d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085291:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93a203bf5a00) 00010000:00010000:0.0:1788744811.085293:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744811.085295:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb39341d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085299:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb39341d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085323:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb39340f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5531f expref: 8 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085331:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393424 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5531f expref: 7 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.085336:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93a203bf5900) 00010000:00010000:0.0:1788744811.085337:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744811.085338:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2048dd400, rc 0) 00000100:00100000:0.0:1788744811.085395:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+7:14410:x1875634451236224:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 560us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744811.085402:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:2.0:1788744811.090642:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744811.090992:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451236480 00000100:00100000:3.0:1788744811.091004:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451236480 00000100:00100000:3.0:1788744811.091077:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:3.0:1788744811.091087:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+7:14410:x1875634451236480:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788744811.091111:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744811.091170:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb39342b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55326 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744811.091275:0:14366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788744811.092266:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb39342b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55326 expref: 9 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.094455:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744811.094467:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744811.094484:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb39342b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55326 expref: 9 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.094509:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051ac00, rc 0) 00000100:00100000:2.0:1788744811.094691:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+8:14410:x1875634451236480:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 3602us (4065us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788744811.094702:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:3.0:1788744811.099096:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744811.101630:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451236736 00000100:00100000:0.0:1788744811.101655:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451236736 00000100:00100000:0.0:1788744811.101728:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:0.0:1788744811.101739:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+8:14410:x1875634451236736:12345-192.168.201.6@tcp:36:lfs.0 00010000:00010000:0.0:1788744811.101817:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744811.101848:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393424 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5531f expref: 8 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.101868:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93a203bf5900) 00010000:00010000:0.0:1788744811.101879:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744811.101906:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393439 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.101920:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393439 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.101930:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393439 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744811.102175:0:14368:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000009d9db830 reply state 00000000ef482a92 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393439 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744811.102186:0:14368:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788744811.102193:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788744811.102529:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+9:14410:x1875634451236736:12345-192.168.201.6@tcp:36:lfs.0 Request processed in 547us (3198us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788744811.102539:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00010000:00010000:3.0:1788744811.104058:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393439 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.104075:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393439 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.104083:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393439 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.104089:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2048dd000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744811.104094:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393439 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.104103:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393439 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.104119:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93a203bf5a00) 00010000:00010000:3.0:1788744811.104122:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788744811.104169:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393439 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.104192:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393439 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744811.104715:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744811.104937:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451236992 00000100:00100000:1.0:1788744811.104956:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451236992 00000100:00100000:1.0:1788744811.105017:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:1.0:1788744811.105029:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+8:14410:x1875634451236992:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788744811.105332:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+9:14410:x1875634451236992:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 304us (619us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788744811.105341:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:1.0:1788744811.109080:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744811.110981:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451237248 00000100:00100000:2.0:1788744811.110999:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451237248 00000100:00100000:2.0:1788744811.111166:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:2.0:1788744811.111178:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+9:14410:x1875634451237248:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788744811.111205:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744811.111240:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb393440 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5532d expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111494:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393447 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111511:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111525:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111542:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb39344e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111548:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb39344e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111574:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb39344e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744811.111700:0:14366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788744811.111797:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393447 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111805:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393447 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111813:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393447 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111819:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744811.111823:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393447 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111831:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393447 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111841:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:2.0:1788744811.111844:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744811.111850:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393447 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111855:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393447 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111868:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb39344e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111883:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb39344e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111888:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb39344e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111893:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744811.111896:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb39344e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111902:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb39344e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111910:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93a209e2e900) 00010000:00010000:2.0:1788744811.111912:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744811.111914:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb39344e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111919:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb39344e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111958:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb393440 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5532d expref: 11 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111967:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:2.0:1788744811.111969:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744811.111972:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2a00/0x4b162761eb393440 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5532d expref: 11 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.111993:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2a00, rc 0) 00000100:00100000:2.0:1788744811.112457:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+10:14410:x1875634451237248:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1279us (3385us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788744811.112466:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:3.0:1788744811.118630:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744811.118866:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451237376 00000100:00100000:0.0:1788744811.118878:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451237376 00000100:00100000:0.0:1788744811.118943:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:0.0:1788744811.118953:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+10:14410:x1875634451237376:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788744811.118982:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744811.119006:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb39345c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55334 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.119125:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393463 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.119183:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393463 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.119195:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393463 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744811.119232:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788744811.119237:0:14367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744811.119255:0:14367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393463 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.119293:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb39345c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55334 expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.119313:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393463 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55334 expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.119321:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93a203bf5900) 00010000:00010000:0.0:1788744811.119324:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744811.119327:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2048dde00, rc 0) 00000100:00100000:0.0:1788744811.119387:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+11:14410:x1875634451237376:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 435us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744811.119395:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:3.0:1788744811.122482:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744811.122576:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451237504 00000100:00100000:1.0:1788744811.122587:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451237504 00000100:00100000:1.0:1788744811.122648:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:1.0:1788744811.122659:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+11:14410:x1875634451237504:12345-192.168.201.6@tcp:37:lfs.0 00000100:00100000:1.0:1788744811.129784:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+11:14410:x1875634451237504:12345-192.168.201.6@tcp:37:lfs.0 Request processed in 7112us (7297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744811.129798:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:3.0:1788744811.132844:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744811.133118:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451237760 00000100:00100000:2.0:1788744811.133160:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451237760 00000100:00100000:2.0:1788744811.133261:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:2.0:1788744811.133272:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+11:14410:x1875634451237760:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:2.0:1788744811.133528:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+12:14410:x1875634451237760:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 257us (692us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788744811.133536:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:2.0:1788744811.214074:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744811.214227:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451237888 00000100:00100000:3.0:1788744811.214239:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451237888 00000100:00100000:3.0:1788744811.214324:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:3.0:1788744811.214336:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d56ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+10:14416:x1875634451237888:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788744811.214362:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744811.214384:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb39346a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5533b expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214475:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb393471 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214490:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb393471 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214501:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb393471 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214514:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393478 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214521:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214547:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214658:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb39347f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214667:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb39347f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214674:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb39347f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744811.214705:0:14366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788744811.214709:0:14366:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744811.214747:0:14366:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb39347f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214759:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb393471 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214765:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb393471 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214772:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb393471 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214778:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051a400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744811.214783:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb393471 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214790:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb393471 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214809:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:3.0:1788744811.214812:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744811.214818:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb393471 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214824:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb393471 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214840:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214847:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393478 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214853:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393478 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214859:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744811.214862:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393478 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214868:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393478 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214875:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744811.214877:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744811.214879:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393478 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214884:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393478 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214931:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb39346a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5533b expref: 12 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214945:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a800/0x4b162761eb39347f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5533b expref: 11 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744811.214953:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93a203bf5900) 00010000:00010000:3.0:1788744811.214955:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788744811.214957:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051a800, rc 0) 00000100:00100000:3.0:1788744811.215024:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d56ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+11:14416:x1875634451237888:12345-192.168.201.6@tcp:101:bash.0 Request processed in 692us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744811.215032:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:3.0:1788744811.217661:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744811.217802:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451238144 00000100:00100000:2.0:1788744811.217814:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451238144 00000100:00100000:2.0:1788744811.217867:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:2.0:1788744811.217878:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+11:14416:x1875634451238144:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788744811.217896:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744811.217914:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393486 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55342 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.218013:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39348d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.218027:0:14368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393463 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55334 expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.218062:0:14368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39348d lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.218094:0:14368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393463 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55334 expref: 11 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.218107:0:14368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393463 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55334 expref: 11 pid: 14367 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744811.218120:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14368:1875634475344640:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744811.218250:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23f861540 going to sleep for 11 seconds 00000100:00100000:2.0:1788744811.220738:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744811.220866:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451238272 00000100:00100000:1.0:1788744811.220878:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451238272 00000100:00100000:0.0:1788744811.220908:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14368:1875634475344640:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788744811.220914:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393463 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55334 expref: 12 pid: 14367 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.220934:0:14368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39348d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744811.220951:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:1.0:1788744811.220960:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+12:2359:x1875634451238272:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744811.220974:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744811.220981:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393463 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55334 expref: 12 pid: 14367 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.220993:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393463 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55334 expref: 12 pid: 14367 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.221021:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393463 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55334 expref: 12 pid: 14367 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.221036:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93a203bf5900) 00010000:00010000:1.0:1788744811.221041:0:14352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39348d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.221050:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39348d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.221057:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39348d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.221085:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744811.221169:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+11:2359:x1875634451238272:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 209us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744811.221177:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00010000:00010000:0.0:1788744811.221303:0:14368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39348d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.221311:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39348d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.221334:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393494 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.221345:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393494 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.221353:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393494 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.222040:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc200/0x4b162761eb39349b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.222050:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc200/0x4b162761eb39349b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.222059:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc200/0x4b162761eb39349b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744811.222069:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788744811.222092:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39348d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.222098:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39348d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.222104:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39348d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.222117:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744811.222122:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39348d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.222152:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39348d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.222163:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93a203bf5900) 00010000:00010000:0.0:1788744811.222166:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744811.222170:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39348d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.222175:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39348d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744811.222187:0:14368:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000498653ff reply state 000000007143d0e4 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393494 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744811.222197:0:14368:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788744811.222242:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393486 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55342 expref: 14 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.222258:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc200/0x4b162761eb39349b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55342 expref: 13 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.222265:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:0.0:1788744811.222267:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788744811.222269:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2048dc200, rc 0) 00000100:00100000:0.0:1788744811.222325:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+14:14416:x1875634451238144:12345-192.168.201.6@tcp:101:bash.0 Request processed in 4449us (4673us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788744811.222339:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00010000:00010000:0.0:1788744811.226826:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393494 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.226844:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393494 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.226852:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393494 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.226859:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2048dd200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744811.226863:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393494 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.226872:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393494 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.226888:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93a203bf5d00) 00010000:00010000:0.0:1788744811.226892:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744811.226896:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393494 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.226903:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb393494 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744811.239737:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744811.240314:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451238400 00000100:00100000:0.0:1788744811.240325:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451238400 00000100:00100000:0.0:1788744811.240391:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:0.0:1788744811.240403:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+13:14416:x1875634451238400:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1788744811.240427:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744811.240462:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb3934a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55349 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.240536:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dda00/0x4b162761eb3934b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.240551:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dda00/0x4b162761eb3934b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.240563:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dda00/0x4b162761eb3934b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744811.240606:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788744811.240610:0:14367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744811.240628:0:14367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dda00/0x4b162761eb3934b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.240648:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dda00/0x4b162761eb3934b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.240673:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb3934a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55349 expref: 15 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.240692:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dda00/0x4b162761eb3934b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55349 expref: 14 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.240700:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:0.0:1788744811.240703:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744811.240707:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2048dda00, rc 0) 00000100:00100000:0.0:1788744811.240777:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+14:14416:x1875634451238400:12345-192.168.201.6@tcp:101:bash.0 Request processed in 376us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744811.240792:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:2.0:1788744811.243043:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744811.243181:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451238656 00000100:00100000:1.0:1788744811.243191:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451238656 00000100:00100000:1.0:1788744811.243253:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:1.0:1788744811.243262:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+14:14416:x1875634451238656:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:1.0:1788744811.243624:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+15:14416:x1875634451238656:12345-192.168.201.6@tcp:35:bash.0 Request processed in 361us (590us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788744811.243633:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:1.0:1788744811.343670:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744811.343954:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451238912 00000100:00100000:0.0:1788744811.343966:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451238912 00000100:00100000:0.0:1788744811.344032:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:0.0:1788744811.344043:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+15:14426:x1875634451238912:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788744811.344066:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744811.344088:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb3934b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55350 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744811.344223:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788744811.344354:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb3934b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55350 expref: 17 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.344369:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a21a9ae000) 00010000:00010000:0.0:1788744811.344372:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744811.344378:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd200/0x4b162761eb3934b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55350 expref: 17 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.344393:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2048dd200, rc 0) 00000100:00100000:0.0:1788744811.344463:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+16:14426:x1875634451238912:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 422us (802us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788744811.344470:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:3.0:1788744811.354666:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744811.354749:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451239168 00000100:00100000:1.0:1788744811.354761:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451239168 00000100:00100000:1.0:1788744811.354851:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1788744811.354861:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+16:14426:x1875634451239168:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788744811.355350:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+17:14426:x1875634451239168:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 488us (696us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788744811.355359:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:2.0:1788744811.441713:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744811.441826:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451239424 00000100:00100000:0.0:1788744811.441836:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451239424 00000100:00100000:0.0:1788744811.441900:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:0.0:1788744811.441911:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+17:14429:x1875634451239424:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788744811.441951:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744811.441974:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc800/0x4b162761eb3934c5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55357 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.442074:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb3934cc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.442085:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb3934cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.442095:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb3934cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744811.442103:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788744811.442307:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc800/0x4b162761eb3934c5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55357 expref: 20 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.442327:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb3934cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55357 expref: 19 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.442336:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:0.0:1788744811.442340:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744811.442343:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2048dd800, rc 0) 00000100:00100000:0.0:1788744811.442407:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+19:14429:x1875634451239424:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 498us (705us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788744811.442413:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:0.0:1788744811.445958:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744811.446047:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451239552 00000100:00100000:2.0:1788744811.446057:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451239552 00000100:00100000:2.0:1788744811.446165:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:2.0:1788744811.446177:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+19:14429:x1875634451239552:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:2.0:1788744811.446256:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb3934da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.446273:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb3934da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.446284:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb3934da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.446329:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb3934da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.446337:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb3934da lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.446344:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb3934da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.446350:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744811.446354:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb3934da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.446361:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb3934da lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.446374:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:2.0:1788744811.446377:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744811.446382:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb3934da lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.446388:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb3934da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744811.446811:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+19:14429:x1875634451239552:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 634us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744811.446819:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:2.0:1788744811.452017:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744811.452227:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451239680 00000100:00100000:0.0:1788744811.452237:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451239680 00000100:00100000:0.0:1788744811.452307:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:0.0:1788744811.452316:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+19:2360:x1875634451239680:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744811.452334:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744811.452358:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb3934cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55357 expref: 19 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.452379:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:0.0:1788744811.452385:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744811.452464:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+18:2360:x1875634451239680:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 149us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744811.452472:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:3.0:1788744811.455320:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744811.455713:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451239936 00000100:00100000:1.0:1788744811.455726:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451239936 00000100:00100000:1.0:1788744811.455787:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1788744811.455798:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+18:14429:x1875634451239936:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788744811.456049:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+19:14429:x1875634451239936:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 251us (739us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788744811.456057:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00010000:00010000:2.0:1788744811.700987:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744811.827439:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744811.831291:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451240192 00000100:00100000:2.0:1788744811.831320:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451240192 00000100:00100000:2.0:1788744811.831372:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:2.0:1788744811.831379:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+19:14460:x1875634451240192:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:2.0:1788744811.831405:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744811.831426:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb3934e1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5535e expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.831524:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3934e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.831537:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3934e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.831546:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3934e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744811.831556:0:14366:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788744811.831695:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb3934e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5535e expref: 22 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.832545:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3934e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5535e expref: 21 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.832555:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:2.0:1788744811.832558:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744811.832562:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f3200, rc 0) 00000100:00100000:2.0:1788744811.832640:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+21:14460:x1875634451240192:12345-192.168.201.6@tcp:101:cat.0 Request processed in 1260us (5212us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788744811.832646:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:3.0:1788744811.836589:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744811.836690:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451240448 00000100:00100000:1.0:1788744811.836700:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451240448 00000100:00100000:1.0:1788744811.836758:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1788744811.836769:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+21:14460:x1875634451240448:12345-192.168.201.6@tcp:35:cat.0 00000100:00100000:1.0:1788744811.837122:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+22:14460:x1875634451240448:12345-192.168.201.6@tcp:35:cat.0 Request processed in 353us (550us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788744811.837165:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1788744811.837792:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744811.837913:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451240576 00000100:00100000:2.0:1788744811.837920:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451240576 00000100:00100000:2.0:1788744811.837968:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:2.0:1788744811.837977:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+22:2359:x1875634451240576:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744811.837989:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744811.838014:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3934e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5535e expref: 22 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.838031:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:2.0:1788744811.838036:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744811.838074:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d137800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+21:2359:x1875634451240576:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 99us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744811.838081:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:3.0:1788744811.917608:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744811.917923:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451240832 00000100:00100000:0.0:1788744811.917934:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451240832 00000100:00100000:0.0:1788744811.917992:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:0.0:1788744811.918001:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+21:14466:x1875634451240832:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:0.0:1788744811.918033:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744811.918166:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb3934f6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55365 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.918314:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc800/0x4b162761eb3934fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.918334:0:14367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc200/0x4b162761eb39349b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55342 expref: 22 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.918343:0:14367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dda00/0x4b162761eb3934b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55349 expref: 22 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.918368:0:14367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc800/0x4b162761eb3934fd lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.918409:0:14367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dda00/0x4b162761eb3934b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55349 expref: 22 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.918425:0:14367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dda00/0x4b162761eb3934b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55349 expref: 22 pid: 14367 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744811.918442:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1069b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14367:1875634475344768:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788744811.918860:0:14367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc200/0x4b162761eb39349b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55342 expref: 22 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.918868:0:14367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc200/0x4b162761eb39349b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55342 expref: 22 pid: 14368 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744811.918874:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1069b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14367:1875634475344896:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788744811.918903:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220a6b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788744811.921987:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1069b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14367:1875634475344768:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788744811.925825:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744811.925892:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744811.925942:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1069b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14367:1875634475344896:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788744811.925971:0:14367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc800/0x4b162761eb3934fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744811.926045:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451240960 00000100:00100000:2.0:1788744811.926054:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451240960 00010000:00010000:2.0:1788744811.926091:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dda00/0x4b162761eb3934b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55349 expref: 23 pid: 14367 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744811.926125:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451241088 00000100:00100000:2.0:1788744811.926157:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451241088 00010000:00010000:2.0:1788744811.926171:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc200/0x4b162761eb39349b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55342 expref: 24 pid: 14368 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744811.926189:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:2.0:1788744811.926207:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a239433c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+24:2360:x1875634451240960:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744811.926223:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744811.926230:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dda00/0x4b162761eb3934b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55349 expref: 24 pid: 14367 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.926261:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dda00/0x4b162761eb3934b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55349 expref: 24 pid: 14367 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.926282:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dda00/0x4b162761eb3934b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55349 expref: 24 pid: 14367 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.926298:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:2.0:1788744811.926304:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc800/0x4b162761eb3934fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.926312:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc800/0x4b162761eb3934fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.926318:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744811.926369:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a239433c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+23:2360:x1875634451240960:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 172us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744811.926376:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:2.0:1788744811.926428:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:2.0:1788744811.926435:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d137100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+22:2359:x1875634451241088:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744811.926443:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744811.926449:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc200/0x4b162761eb39349b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55342 expref: 22 pid: 14368 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.926459:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc200/0x4b162761eb39349b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55342 expref: 22 pid: 14368 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.926484:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc200/0x4b162761eb39349b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d55342 expref: 22 pid: 14368 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.926494:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:2.0:1788744811.926498:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc800/0x4b162761eb3934fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.926505:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc800/0x4b162761eb3934fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.926512:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc800/0x4b162761eb3934fd lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.926534:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744811.926556:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d137100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+21:2359:x1875634451241088:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 121us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744811.926563:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00010000:00010000:0.0:1788744811.927010:0:14367:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc800/0x4b162761eb3934fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.927031:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc800/0x4b162761eb3934fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744811.927050:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788744811.927260:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb3934f6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55365 expref: 22 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.927276:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc800/0x4b162761eb3934fd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55365 expref: 21 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.927284:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:0.0:1788744811.927287:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788744811.927290:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2048dc800, rc 0) 00000100:00100000:0.0:1788744811.927330:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+21:14466:x1875634451240832:12345-192.168.201.6@tcp:101:dd.0 Request processed in 9330us (9734us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788744811.927337:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:3.0:1788744811.930941:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744811.931944:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451241344 00000100:00100000:2.0:1788744811.931953:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451241344 00000100:00100000:2.0:1788744811.932002:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:2.0:1788744811.932010:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+21:14466:x1875634451241344:12345-192.168.201.6@tcp:36:dd.0 00010000:00010000:2.0:1788744811.932294:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb39350b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.932309:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb39350b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.932317:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb39350b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744811.932373:0:14366:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788744811.932396:0:14366:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000000fafe98b reply state 00000000c45f113e transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb39350b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744811.932405:0:14366:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744811.932511:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+24:14466:x1875634451241344:12345-192.168.201.6@tcp:36:dd.0 Request processed in 500us (1578us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788744811.932519:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00000020:00080000:2.0:1788744811.932524:0:14366:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788744811.934867:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744811.935236:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451241472 00000100:00100000:0.0:1788744811.935247:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451241472 00000100:00100000:0.0:1788744811.935304:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:0.0:1788744811.935315:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+24:14466:x1875634451241472:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:0.0:1788744811.935339:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744811.935359:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc000/0x4b162761eb393512 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5536c expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.935418:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc000/0x4b162761eb393512 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5536c expref: 25 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.935454:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc000/0x4b162761eb393512 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5536c expref: 25 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.935476:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:0.0:1788744811.935479:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744811.935482:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2048dc000, rc 0) 00000100:00100000:0.0:1788744811.935541:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+25:14466:x1875634451241472:12345-192.168.201.6@tcp:101:dd.0 Request processed in 227us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744811.935548:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00010000:00010000:1.0:1788744811.938460:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb39350b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.938478:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb39350b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.938486:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb39350b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.938514:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744811.938520:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb39350b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.938528:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb39350b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.938545:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:1.0:1788744811.938547:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744811.938553:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb39350b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744811.938559:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb39350b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744811.962425:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744811.963722:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451241728 00000100:00100000:2.0:1788744811.963735:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451241728 00000100:00100000:2.0:1788744811.963799:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:2.0:1788744811.963810:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+24:14466:x1875634451241728:12345-192.168.201.6@tcp:103:dd.0 00010000:00010000:2.0:1788744811.963830:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744811.963859:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dc000/0x4b162761eb393512 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5536c expref: 24 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.963881:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:2.0:1788744811.963887:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744811.964038:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+23:14466:x1875634451241728:12345-192.168.201.6@tcp:103:dd.0 Request processed in 229us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744811.964046:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:3.0:1788744811.968674:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744811.969632:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451241856 00000100:00100000:0.0:1788744811.969644:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451241856 00000100:00100000:0.0:1788744811.969718:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:0.0:1788744811.969729:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+23:14466:x1875634451241856:12345-192.168.201.6@tcp:58:dd.0 00010000:00010000:0.0:1788744811.969890:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb393519 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.969910:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb393519 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744811.969924:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb393519 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788744811.976861:0:14368:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744811.978824:0:14368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788744811.978931:0:14368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788744811.980879:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+23:14466:x1875634451241856:12345-192.168.201.6@tcp:58:dd.0 Request processed in 11135us (12200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744811.980918:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:3.0:1788744811.984172:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744811.984267:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451241984 00000100:00100000:2.0:1788744811.984279:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451241984 00000100:00100000:2.0:1788744811.984345:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:2.0:1788744811.984356:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+23:14466:x1875634451241984:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:2.0:1788744811.984400:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744811.984424:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb393520 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55373 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.984485:0:14366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb393519 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.984496:0:14366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb393520 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55373 expref: 24 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.984516:0:14366:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb393519 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.984530:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb393520 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55373 expref: 24 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.984545:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:2.0:1788744811.984548:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744811.984551:0:14366:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb393520 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55373 expref: 24 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744811.984558:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2800, rc 0) 00000100:00100000:2.0:1788744811.984625:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+24:14466:x1875634451241984:12345-192.168.201.6@tcp:101:dd.0 Request processed in 271us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744811.984633:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00000040:00080000:3.0:1788744812.020860:0:14400:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788744812.020883:0:14400:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744812.020939:0:14400:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788744812.020947:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788744812.025329:0:14400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23d636300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14400:1875634475345024:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744812.025461:0:14400:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a204f03a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744812.029289:0:14400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23d636300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14400:1875634475345024:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744812.029644:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744812.032226:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451242112 00000100:00100000:1.0:1788744812.032652:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451242112 00000100:00100000:1.0:1788744812.032758:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1788744812.032776:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:048fcf10-bca2-4fd1-9809-4e3b531d6735+24:14467:x1875634451242112:12345-192.168.201.6@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788744812.032886:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:048fcf10-bca2-4fd1-9809-4e3b531d6735+24:14467:x1875634451242112:12345-192.168.201.6@tcp:900:lhsmtool_posix.0 Request processed in 118us (3243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744812.032895:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00080000:0.0:1788744812.032976:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744812.043214:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744812.043278:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451242240 00000100:00100000:0.0:1788744812.043288:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451242240 00000100:00100000:0.0:1788744812.043347:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:0.0:1788744812.043358:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+24:14467:x1875634451242240:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788744812.043389:0:14368:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788744812.043492:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+24:14467:x1875634451242240:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 136us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744812.043499:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:3.0:1788744812.064768:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744812.067278:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451242368 00000100:00100000:0.0:1788744812.067295:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451242368 00000100:00100000:0.0:1788744812.067379:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:0.0:1788744812.067391:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+24:14467:x1875634451242368:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788744812.067466:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393527 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067485:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393527 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067499:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393527 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067570:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb39352e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067579:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb39352e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067606:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb39352e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067631:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393535 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067640:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393535 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067647:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393535 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744812.067686:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788744812.067690:0:14367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744812.067703:0:14367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393535 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067714:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393527 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067721:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393527 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067728:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393527 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067733:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2048dde00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744812.067737:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393527 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067745:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393527 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067763:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93a21a9aec00) 00010000:00010000:0.0:1788744812.067766:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744812.067772:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393527 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067779:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dde00/0x4b162761eb393527 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067795:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb39352e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067802:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb39352e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067808:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb39352e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067814:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2048dd400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744812.067817:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb39352e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067822:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb39352e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067829:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff93a203bf5d00) 00010000:00010000:0.0:1788744812.067832:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744812.067835:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb39352e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067841:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb39352e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067869:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393535 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067876:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393535 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067883:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393535 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067888:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2048dd000 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:0.0:1788744812.067891:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393535 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067897:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393535 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067906:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:0.0:1788744812.067908:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744812.067911:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393535 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.067917:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd000/0x4b162761eb393535 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744812.068011:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+24:14467:x1875634451242368:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 Request processed in 622us (3250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744812.068019:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:3.0:1788744812.074339:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744812.074737:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451242624 00000100:00100000:2.0:1788744812.074748:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451242624 00000100:00100000:2.0:1788744812.074819:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:2.0:1788744812.074844:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+24:14467:x1875634451242624:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744812.074866:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744812.074888:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb39353c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5537a expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.074983:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393543 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.075011:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393543 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.075023:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393543 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744812.075036:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788744812.075175:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393543 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.075183:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393543 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.075190:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393543 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.075208:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744812.075212:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393543 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.075220:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393543 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.075231:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:2.0:1788744812.075240:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788744812.075244:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393543 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.075251:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393543 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.075296:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb39353c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5537a expref: 26 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.075305:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93a21a9aec00) 00010000:00010000:2.0:1788744812.075307:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744812.075311:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb39353c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5537a expref: 26 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.075319:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2400, rc 0) 00000100:00100000:2.0:1788744812.075381:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+25:14467:x1875634451242624:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 539us (1051us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788744812.075388:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:3.0:1788744812.079831:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744812.079910:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451242752 00000100:00100000:0.0:1788744812.079921:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451242752 00000100:00100000:0.0:1788744812.079986:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:0.0:1788744812.080011:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+25:14467:x1875634451242752:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788744812.080049:0:14367:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788744812.080191:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+25:14467:x1875634451242752:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 182us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744812.080208:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:0.0:1788744812.087229:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744812.087460:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451243008 00000100:00100000:3.0:1788744812.087471:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451243008 00000100:00100000:3.0:1788744812.087539:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:3.0:1788744812.087551:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+25:14467:x1875634451243008:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744812.087573:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744812.087600:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393551 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55381 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788744812.088370:0:14366:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1788744812.088379:0:14366:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1788744812.088432:0:14366:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788744812.088714:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb393558 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.088732:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb393558 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.088745:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb393558 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.088814:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393551 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55381 expref: 28 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.088834:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb393558 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55381 expref: 27 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.088843:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:3.0:1788744812.088846:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744812.088850:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051ac00, rc 0) 00000100:00100000:3.0:1788744812.088926:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+27:14467:x1875634451243008:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1376us (1706us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1788744812.088934:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:3.0:1788744812.102324:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744812.102493:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451243264 00000100:00100000:2.0:1788744812.102504:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451243264 00000100:00100000:2.0:1788744812.102578:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:2.0:1788744812.102589:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+27:14467:x1875634451243264:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788744812.102651:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744812.102689:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051ac00/0x4b162761eb393558 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55381 expref: 27 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102711:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93a21a9ae800) 00010000:00010000:2.0:1788744812.102737:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744812.102760:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393566 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102775:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393566 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102786:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393566 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102801:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39356d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x851f69ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102808:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39356d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x851f69ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102815:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39356d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x851f69ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102877:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393566 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102885:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393566 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102891:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393566 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102897:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744812.102901:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393566 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102909:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393566 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102923:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93a203bf5900) 00010000:00010000:2.0:1788744812.102926:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744812.102931:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393566 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102938:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393566 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102948:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39356d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x851f69ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102954:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39356d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x851f69ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102961:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39356d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x851f69ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102966:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744812.102969:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39356d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x851f69ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102975:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39356d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x851f69ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102982:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x851f69ea (ffff93a209e2e900) 00010000:00010000:2.0:1788744812.102985:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744812.102987:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39356d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x851f69ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.102993:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb39356d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x851f69ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744812.103088:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+26:14467:x1875634451243264:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 500us (775us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788744812.103095:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:1.0:1788744812.105509:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744812.105784:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451243392 00000100:00100000:3.0:1788744812.105794:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451243392 00000100:00100000:3.0:1788744812.105859:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:3.0:1788744812.105871:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+26:14467:x1875634451243392:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744812.105893:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744812.105917:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393574 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55388 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.105958:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb39357b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.105972:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb39357b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.106006:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb39357b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.106110:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393574 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55388 expref: 28 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.106381:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051a400/0x4b162761eb39357b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55388 expref: 27 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.106391:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93a21a9aee00) 00010000:00010000:3.0:1788744812.106395:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788744812.106398:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051a400, rc 0) 00000100:00100000:3.0:1788744812.106461:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+27:14467:x1875634451243392:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 593us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744812.106468:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:3.0:1788744812.108642:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744812.108717:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451243648 00000100:00100000:0.0:1788744812.108725:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451243648 00000100:00100000:0.0:1788744812.108781:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:0.0:1788744812.108791:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+27:14467:x1875634451243648:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788744812.108866:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393582 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.108883:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393582 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.108895:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393582 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788744812.109470:0:14367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788744812.109480:0:14367:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 514808349815ns, next at 515808347253ns, rc = 0 00000004:00010000:0.0:1788744812.109575:0:14367:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000009d40162c reply state 000000005da1636d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393582 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744812.109585:0:14367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788744812.109732:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+29:14467:x1875634451243648:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 941us (1096us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788744812.109740:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:2.0:1788744812.114871:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744812.114926:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451243776 00000100:00100000:3.0:1788744812.114936:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451243776 00000100:00100000:3.0:1788744812.115040:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:3.0:1788744812.115052:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+29:14467:x1875634451243776:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744812.115062:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393582 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.115075:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393582 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.115076:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744812.115086:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393582 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.115094:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2048dd400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744812.115098:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393589 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5538f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.115099:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393582 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.115118:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393582 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.115174:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93a21a9aee00) 00010000:00010000:0.0:1788744812.115178:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788744812.115187:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393582 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.115203:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd400/0x4b162761eb393582 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.115295:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393589 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5538f expref: 29 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.115327:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393589 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5538f expref: 29 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.115345:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93a21a9aee00) 00010000:00010000:3.0:1788744812.115348:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744812.115351:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a23051b400, rc 0) 00000100:00100000:3.0:1788744812.115406:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+29:14467:x1875634451243776:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 357us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744812.115420:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:1.0:1788744812.124062:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744812.126012:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451243904 00000100:00100000:0.0:1788744812.126026:0:15050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451243904 00000100:00100000:0.0:1788744812.126099:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1788744812.126112:0:15050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a207ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:2360:x1875634451243904:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788744812.126514:0:15050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a207ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:2360:x1875634451243904:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 403us (2461us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788744812.126523:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00080000:1.0:1788744812.127020:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744812.139686:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744812.139870:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451244160 00000100:00100000:1.0:1788744812.139895:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451244160 00000100:00100000:1.0:1788744812.139966:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:1.0:1788744812.139977:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+29:14467:x1875634451244160:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788744812.140456:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+30:14467:x1875634451244160:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 479us (781us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788744812.140464:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:3.0:1788744812.143215:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744812.143449:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451244416 00000100:00100000:2.0:1788744812.143459:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451244416 00000100:00100000:2.0:1788744812.143512:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:2.0:1788744812.143523:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+30:14467:x1875634451244416:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788744812.143638:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+30:14467:x1875634451244416:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 116us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744812.143645:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:3.0:1788744812.146216:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744812.146393:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451244544 00000100:00100000:2.0:1788744812.146403:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451244544 00000100:00100000:2.0:1788744812.146463:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:2.0:1788744812.146474:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+30:14467:x1875634451244544:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744812.146497:0:14366:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744812.146517:0:14366:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393590 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d55396 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.146600:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393597 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.146614:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393597 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.146624:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393597 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744812.146671:0:14366:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744812.146687:0:14366:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393597 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.146712:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb393590 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55396 expref: 32 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.146731:0:14366:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393597 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55396 expref: 31 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.146739:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93a21a9aee00) 00010000:00010000:2.0:1788744812.146742:0:14366:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788744812.146745:0:14366:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2400, rc 0) 00000100:00100000:2.0:1788744812.146805:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+31:14467:x1875634451244544:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 333us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744812.146812:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:3.0:1788744812.149614:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744812.149766:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451244672 00000100:00100000:0.0:1788744812.149777:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451244672 00000100:00100000:0.0:1788744812.149845:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:0.0:1788744812.149856:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:2359:x1875634451244672:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744812.149875:0:15049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744812.149897:0:15049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032562c51/0x4b162761eb39359e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d5539d expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744812.149928:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e146b, blocks: 0x1 00010000:00010000:0.0:1788744812.149949:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=514s v=(0 0) 00010000:00010000:0.0:1788744812.149954:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744812.149963:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032562c51/0x4b162761eb39359e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5539d expref: 7 pid: 15049 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.149987:0:15049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032562c51/0x4b162761eb39359e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5539d expref: 7 pid: 15049 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.150000:0:15049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2048dd400, rc 0) 00000100:00100000:0.0:1788744812.150062:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+7:2359:x1875634451244672:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 208us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744812.150069:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:3.0:1788744812.153259:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744812.153467:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451244928 00000100:00100000:0.0:1788744812.153477:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451244928 00000100:00100000:0.0:1788744812.153540:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:0.0:1788744812.153551:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+31:14467:x1875634451244928:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788744812.153688:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+31:14467:x1875634451244928:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 139us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744812.153696:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:3.0:1788744812.160471:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744812.160746:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451245056 00000100:00100000:0.0:1788744812.160756:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451245056 00000100:00100000:0.0:1788744812.160820:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:0.0:1788744812.160831:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+31:14467:x1875634451245056:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788744812.246298:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+31:14467:x1875634451245056:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 Request processed in 85458us (85827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744812.246313:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00000001:00080000:1.0:1788744812.246448:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:1.0:1788744812.246456:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788744812.246489:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:1.0:1788744812.246496:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1788744812.246508:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:1.0:1788744812.246524:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1788744812.246814:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744812.246832:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475345152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788744812.246885:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744812.246957:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475345152 00000100:00100000:3.0:1788744812.246965:0:15050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475345152 00000100:00080000:1.0:1788744812.247004:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744812.247018:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744812.247028:0:15050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875634475345152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788744812.247286:0:15050:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788744812.247290:0:15050:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788744812.247292:0:15050:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788744812.247295:0:15050:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788744811 -> 1788744811 00002000:00010000:0.0:1788744812.247297:0:15050:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788744812.247342:0:15050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875634475345152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 315us (456us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788744812.247350:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1788744812.247486:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93a23b4c3b80/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788744812.247493:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875634475345152:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788744812.263846:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744812.263939:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451245184 00000100:00100000:0.0:1788744812.263950:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451245184 00000100:00100000:0.0:1788744812.264071:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:0.0:1788744812.264083:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+7:2360:x1875634451245184:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788744812.264597:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+7:2360:x1875634451245184:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 Request processed in 514us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744812.264607:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1788744812.273214:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744812.273361:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451245440 00000100:00100000:2.0:1788744812.273372:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451245440 00000100:00100000:2.0:1788744812.273427:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:2.0:1788744812.273438:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+14:14467:x1875634451245440:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788744812.273496:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744812.273525:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb393597 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55396 expref: 14 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.273544:0:14366:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93a21a9aee00) 00010000:00010000:2.0:1788744812.273549:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744812.273599:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3935a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.273615:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3935a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.273626:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3935a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744812.273823:0:14366:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000ba92dc2e reply state 0000000055eadfb7 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3935a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744812.273833:0:14366:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744812.273932:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+15:14467:x1875634451245440:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 494us (726us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788744812.273939:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:0.0:1788744812.276841:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744812.277485:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451245568 00000100:00100000:2.0:1788744812.277495:0:15050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451245568 00000100:00100000:2.0:1788744812.277546:0:15050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:2.0:1788744812.277557:0:15050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+7:14467:x1875634451245568:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744812.277575:0:15050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744812.277594:0:15050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e5822b5/0x4b162761eb3935ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x786e03e382d553a4 expref: -99 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.277624:0:15050:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032562c51/0x4b162761eb39359e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5539d expref: 8 pid: 15049 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.277633:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744812.277637:0:15050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744812.277651:0:15050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e5822b5/0x4b162761eb3935ac lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d553a4 expref: 8 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.277683:0:15050:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032562c51/0x4b162761eb39359e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5539d expref: 8 pid: 15049 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.277698:0:15050:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032562c51/0x4b162761eb39359e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5539d expref: 8 pid: 15049 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744812.277713:0:15050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15050:1875634475345280:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744812.277808:0:15050:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23f861d80 going to sleep for 11 seconds 00010000:00010000:1.0:1788744812.277995:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3935a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.278006:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3935a5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.278014:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3935a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.278020:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2c00 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:1.0:1788744812.278025:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3935a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.278039:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3935a5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.278052:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93a21a9aee00) 00010000:00010000:1.0:1788744812.278055:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744812.278060:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3935a5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.278066:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2c00/0x4b162761eb3935a5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14366 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744812.280378:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744812.280453:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451245696 00000100:00100000:1.0:1788744812.280463:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451245696 00010000:00010000:1.0:1788744812.280500:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032562c51/0x4b162761eb39359e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5539d expref: 9 pid: 15049 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744812.280543:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:1.0:1788744812.280552:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+9:2359:x1875634451245696:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744812.280566:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744812.280588:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032562c51/0x4b162761eb39359e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5539d expref: 9 pid: 15049 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.280603:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032562c51/0x4b162761eb39359e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5539d expref: 9 pid: 15049 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.280628:0:14352:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744812.280633:0:14352:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744812.280653:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003e5822b5/0x4b162761eb3935ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d553a4 expref: 9 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.280664:0:14352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e5822b5/0x4b162761eb3935ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d553a4 expref: 9 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.280702:0:14352:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003e5822b5/0x4b162761eb3935ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d553a4 expref: 9 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744812.280717:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a207ef3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14352:1875634475345408:192.168.201.6@tcp:105: 00000100:00100000:1.0:1788744812.280809:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a1070a43c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788744812.281013:0:15050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032562c51/0x4b162761eb39359e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5539d expref: 9 pid: 15049 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744812.281029:0:15050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15050:1875634475345280:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744812.281053:0:15050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003e5822b5/0x4b162761eb3935ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d553a4 expref: 8 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.281064:0:15050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a2064f2a00, rc 0) 00000100:00100000:2.0:1788744812.281092:0:15050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+8:14467:x1875634451245568:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 3537us (4260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744812.281099:0:15050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:3.0:1788744812.297357:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744812.297435:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451245824 00000100:00100000:2.0:1788744812.297446:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451245824 00000100:00100000:2.0:1788744812.297521:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:2.0:1788744812.297546:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:048fcf10-bca2-4fd1-9809-4e3b531d6735+8:2359:x1875634451245824:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788744812.297746:0:15495:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788744812.297750:0:15495:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788744811 00002000:00010000:2.0:1788744812.297753:0:15495:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788744810 00002000:00010000:2.0:1788744812.297755:0:15495:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788744811 -> 1788744811 00002000:00010000:2.0:1788744812.297757:0:15495:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788744812.297841:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:048fcf10-bca2-4fd1-9809-4e3b531d6735+9:2359:x1875634451245824:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 298us (492us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788744812.297850:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:1.0:1788744812.302242:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a207ef3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14352:1875634475345408:192.168.201.6@tcp:105: 00010000:00010000:1.0:1788744812.302276:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744812.302352:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+8:2359:x1875634451245696:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 21798us (21981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744812.302365:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:3.0:1788744812.307560:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744812.307882:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451245952 00000100:00100000:0.0:1788744812.307893:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451245952 00000100:00100000:0.0:1788744812.307977:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:0.0:1788744812.307989:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+8:2359:x1875634451245952:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788744812.308043:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935b3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.308066:0:15051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003e5822b5/0x4b162761eb3935ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0x786e03e382d553a4 expref: 8 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.308076:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788744812.308081:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744812.308086:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935b3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.308180:0:15051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003e5822b5/0x4b162761eb3935ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d553a4 expref: 8 pid: 15050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.308209:0:15051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003e5822b5/0x4b162761eb3935ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d553a4 expref: 8 pid: 15050 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744812.308226:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1069b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15051:1875634475345536:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788744812.308337:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a220a6bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744812.311507:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1069b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15051:1875634475345536:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788744812.311549:0:15051:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935b3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744812.312108:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744812.312243:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451246080 00000100:00100000:0.0:1788744812.312263:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451246080 00010000:00010000:0.0:1788744812.312312:0:14351:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003e5822b5/0x4b162761eb3935ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d553a4 expref: 9 pid: 15050 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744812.312359:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:0.0:1788744812.312371:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+9:2359:x1875634451246080:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744812.312386:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744812.312410:0:14351:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003e5822b5/0x4b162761eb3935ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d553a4 expref: 9 pid: 15050 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.312424:0:14351:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003e5822b5/0x4b162761eb3935ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d553a4 expref: 9 pid: 15050 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.312452:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e5822b5/0x4b162761eb3935ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0x786e03e382d553a4 expref: 9 pid: 15050 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.312468:0:14351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744812.312473:0:14351:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744812.312478:0:14351:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.312488:0:14351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935b3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.312538:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744812.312577:0:15051:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.312589:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744812.312597:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+8:2359:x1875634451246080:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 226us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744812.312606:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00010000:00010000:2.0:1788744812.312621:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935b3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.313000:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935b3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.313008:0:15051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.313015:0:15051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2048dce00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744812.313019:0:15051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.313037:0:15051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.313053:0:15051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.313060:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744812.313172:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+7:2359:x1875634451245952:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 Request processed in 5184us (5623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744812.313183:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1788744812.315559:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744812.315756:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451246336 00000100:00100000:2.0:1788744812.315768:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451246336 00000100:00100000:2.0:1788744812.315836:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:2.0:1788744812.315848:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+14:14467:x1875634451246336:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788744812.315933:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3935ba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.315953:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3935ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.315969:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3935ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.316300:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3935c1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.316319:0:14368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393589 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d5538f expref: 15 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.316328:0:14368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3935c1 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.316363:0:14368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393589 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5538f expref: 15 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.316379:0:14368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393589 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5538f expref: 15 pid: 14366 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744812.316395:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14368:1875634475345664:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788744812.316492:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23f861d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744812.326075:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744812.326216:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14368:1875634475345664:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788744812.326247:0:14368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3935c1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744812.326330:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451246464 00000100:00100000:1.0:1788744812.326338:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451246464 00010000:00010000:1.0:1788744812.326387:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393589 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5538f expref: 16 pid: 14366 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744812.326428:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:1.0:1788744812.326438:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+16:2360:x1875634451246464:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744812.326465:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744812.326473:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393589 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5538f expref: 16 pid: 14366 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.326506:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393589 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5538f expref: 16 pid: 14366 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.326529:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a23051b400/0x4b162761eb393589 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0x786e03e382d5538f expref: 16 pid: 14366 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.326547:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93a21a9aee00) 00010000:00010000:1.0:1788744812.326552:0:14352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3935c1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.326562:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3935c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.326570:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3935c1 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.326600:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744812.326666:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c078e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+15:2360:x1875634451246464:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 228us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744812.326673:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00010000:00010000:2.0:1788744812.326730:0:14368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3935c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.326737:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3935c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744812.326916:0:14368:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788744812.327065:0:14368:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788744812.327111:0:14368:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788744812.327255:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14368:1875634475345792:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788744812.327352:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744812.327378:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a207fd63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744812.327576:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475345792 00000100:00100000:1.0:1788744812.327581:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475345792 00000100:00100000:1.0:1788744812.327621:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744812.327638:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14368:x1875634475345792:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788744812.327704:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14368:x1875634475345792:12345-0@lo:1000:mdt00_002.0 Request processed in 68us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744812.327711:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744812.327888:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14368:1875634475345792:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788744812.328551:0:14368:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788744812.328616:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14368:1875634475345920:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788744812.328843:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744812.328870:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a23f861d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744812.329737:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475345920 00000100:00100000:1.0:1788744812.329748:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475345920 00000100:00100000:1.0:1788744812.329808:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744812.329818:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14368:x1875634475345920:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788744812.330057:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14368:x1875634475345920:12345-0@lo:1000:mdt00_002.0 Request processed in 240us (1213us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788744812.330065:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744812.330321:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23b4c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14368:1875634475345920:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788744812.330367:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3935c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.330508:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3935c1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.330519:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3935c1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.330526:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f3200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744812.330531:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3935c1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.330540:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3935c1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.330556:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93a21a9aee00) 00010000:00010000:3.0:1788744812.330560:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744812.330565:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3935c1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.330572:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f3200/0x4b162761eb3935c1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.330605:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb393519 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.330612:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb393519 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.330617:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb393519 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.331622:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2048dd800 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:3.0:1788744812.331681:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb393519 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.331690:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb393519 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.331703:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:3.0:1788744812.331707:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744812.331715:0:14368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb393520 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55373 expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.331728:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb393520 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55373 expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.331738:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb393520 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55373 expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.331782:0:14368:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2800/0x4b162761eb393520 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0x786e03e382d55373 expref: 18 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744812.331797:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c078380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14368:1875634475346048:192.168.201.6@tcp:105: 00000100:00100000:3.0:1788744812.331877:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff93a2147b59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744812.334613:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c078380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14368:1875634475346048:192.168.201.6@tcp:105: 00010000:00010000:2.0:1788744812.334652:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb393519 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334664:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dd800/0x4b162761eb393519 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334702:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2200/0x4b162761eb3935c8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334725:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2200/0x4b162761eb3935c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334739:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2200/0x4b162761eb3935c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334751:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2200/0x4b162761eb3935c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334757:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2200/0x4b162761eb3935c8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334764:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2200/0x4b162761eb3935c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334787:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2200 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744812.334792:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2200/0x4b162761eb3935c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334800:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2200/0x4b162761eb3935c8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334812:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:2.0:1788744812.334816:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744812.334820:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2200/0x4b162761eb3935c8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334826:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2200/0x4b162761eb3935c8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334837:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3935ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334843:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3935ba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334849:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3935ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334854:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2400 already unused, calling callback (ffffffffc20544f0) 00010000:00010000:2.0:1788744812.334856:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3935ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334861:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3935ba lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334879:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93a203bf5000) 00010000:00010000:2.0:1788744812.334882:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788744812.334885:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3935ba lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.334891:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2064f2400/0x4b162761eb3935ba lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744812.335168:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+18:14467:x1875634451246336:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 19321us (19619us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788744812.335179:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00000020:00080000:2.0:1788744812.335186:0:14368:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788744812.336161:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744812.338295:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451246592 00000100:00100000:0.0:1788744812.338310:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451246592 00000100:00100000:0.0:1788744812.338394:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:0.0:1788744812.338406:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a241d24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+18:14466:x1875634451246592:12345-192.168.201.6@tcp:49:dd.0 00000100:00100000:0.0:1788744812.338550:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a241d24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+18:14466:x1875634451246592:12345-192.168.201.6@tcp:49:dd.0 Request processed in 138us (2383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744812.338558:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000040:00080000:1.0:1788744812.339056:0:14400:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788744812.339061:0:14400:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788744812.339092:0:14400:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788744812.339098:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788744812.351969:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744812.352076:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451246848 00000100:00100000:0.0:1788744812.352087:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451246848 00000100:00100000:0.0:1788744812.352207:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788744812.352221:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+18:14467:x1875634451246848:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788744812.353398:0:14370:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788744812.353508:0:14370:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788744812.353555:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dcc00/0x4b162761eb3935cf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.353573:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dcc00/0x4b162761eb3935cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.353585:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dcc00/0x4b162761eb3935cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.353593:0:14370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dcc00/0x4b162761eb3935cf lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.353606:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dcc00/0x4b162761eb3935cf lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.353611:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dcc00/0x4b162761eb3935cf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.353879:0:14370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788744812.354011:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:048fcf10-bca2-4fd1-9809-4e3b531d6735+20:14467:x1875634451246848:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 1791us (2050us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788744812.354020:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000020:00080000:0.0:1788744812.354026:0:14370:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788744812.355406:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744812.355418:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dcc00/0x4b162761eb3935cf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.355430:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2048dcc00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744812.355435:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dcc00/0x4b162761eb3935cf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.355445:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dcc00/0x4b162761eb3935cf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.355472:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93a21a9aee00) 00010000:00010000:2.0:1788744812.355476:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788744812.355481:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dcc00/0x4b162761eb3935cf lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.355487:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a2048dcc00/0x4b162761eb3935cf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.355522:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744812.355524:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744812.355526:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744812.511420:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744812.511531:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744812.511569:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744812.511683:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451246976 00000100:00100000:0.0:1788744812.511693:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451246976 00000100:00100000:0.0:1788744812.511752:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451247232 00000100:00100000:0.0:1788744812.511756:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451247232 00000100:00100000:0.0:1788744812.511770:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451247104 00000100:00100000:0.0:1788744812.511773:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451247104 00000100:00100000:0.0:1788744812.511790:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:0.0:1788744812.511802:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+9:2360:x1875634451246976:12345-192.168.201.6@tcp:4:dd.0 00002000:00010000:0.0:1788744812.511858:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9e146b, atime: 0x6a9e146a, ctime: 0x6a9e146b, blocks: 0x1 00010000:00010000:0.0:1788744812.511869:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.511885:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788744812.511890:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744812.511897:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744812.511926:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744812.662785:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1788744812.662901:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:2.0:1788744812.663153:0:15056:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1788744812.663159:0:15056:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1788744812.663174:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.663199:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.663351:0:15056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.663359:0:15056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2048dce00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744812.663364:0:15056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.663590:0:15056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.663614:0:15056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.663635:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6f87ceb/0x4b162761eb3935d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744812.663926:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+7:2360:x1875634451246976:12345-192.168.201.6@tcp:4:dd.0 Request processed in 152121us (152511us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788744812.663958:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:2.0:1788744812.663995:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:2.0:1788744812.664006:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:2359:x1875634451247232:12345-192.168.201.6@tcp:4:dd.0 00002000:00010000:2.0:1788744812.664052:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6a9e146b, atime: 0x6a9e146a, ctime: 0x0, blocks: 0x803 00010000:00010000:2.0:1788744812.664059:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb3935dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.664072:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788744812.664077:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744812.664083:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb3935dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744812.664095:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb3935dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.724396:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788744812.825352:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:3.0:1788744812.825477:0:15056:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 1048576 -> 3145728 00002000:00010000:3.0:1788744812.825482:0:15056:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:3.0:1788744812.825498:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb3935dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.825513:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb3935dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.825523:0:15056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb3935dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.825529:0:15056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2200 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744812.825534:0:15056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb3935dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.825543:0:15056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb3935dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.825565:0:15056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb3935dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.825571:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb3935dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744812.825687:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+6:2359:x1875634451247232:12345-192.168.201.6@tcp:4:dd.0 Request processed in 161678us (314148us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788744812.825704:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:3.0:1788744812.825760:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:3.0:1788744812.825773:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:2360:x1875634451247104:12345-192.168.201.6@tcp:4:dd.0 00002000:00010000:3.0:1788744812.825815:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9e146b, atime: 0x6a9e146a, ctime: 0x0, blocks: 0x1007 00010000:00010000:3.0:1788744812.825822:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb3935e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.825833:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788744812.825839:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744812.825845:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb3935e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744812.825859:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb3935e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744812.840299:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744812.840334:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744812.840373:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744812.840387:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788744812.840401:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788744812.840507:0:15054:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788744812.840520:0:15054:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788744812.840844:0:15055:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788744812.840858:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451247360 00000100:00100000:3.0:1788744812.840866:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451247360 00000100:00100000:3.0:1788744812.840914:0:15055:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788744812.840918:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451247488 00000100:00100000:3.0:1788744812.840920:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451247488 00000100:00100000:3.0:1788744812.840930:0:15055:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788744812.840933:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451247616 00000100:00100000:3.0:1788744812.840935:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451247616 00000100:00100000:3.0:1788744812.840943:0:15055:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788744812.840947:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451247744 00000100:00100000:3.0:1788744812.840949:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451247744 00000100:00100000:3.0:1788744812.840956:0:15055:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788744812.840959:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451247872 00000100:00100000:3.0:1788744812.840961:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451247872 00000100:00100000:1.0:1788744812.844023:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:1.0:1788744812.844045:0:16599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:048fcf10-bca2-4fd1-9809-4e3b531d6735+11:2360:x1875634451247360:12345-192.168.201.6@tcp:4:dd.0 00010000:00010000:1.0:1788744812.844097:0:16599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aa9cfe7/0x4b162761eb3935eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.844119:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744812.844125:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744812.844276:0:16599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aa9cfe7/0x4b162761eb3935eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744812.844292:0:16599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aa9cfe7/0x4b162761eb3935eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744812.853473:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85c0995c-9591-4016-879e-a5185771e142:3308:1875634475346176:0@lo:400:kworker.0 00000100:00100000:1.0:1788744812.853553:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744812.854230:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475346560:0@lo:400:kworker.0 00000100:00100000:2.0:1788744812.854268:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744812.854460:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475346176 00000100:00100000:0.0:1788744812.854469:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475346176 00000100:00100000:0.0:1788744812.854532:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788744812.854543:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a239458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+19:3308:x1875634475346176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744812.863524:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634475346432:0@lo:400:kworker.0 00000100:00100000:2.0:1788744812.863611:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744812.863660:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744812.863668:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475346304:0@lo:400:kworker.0 00000100:00100000:2.0:1788744812.863691:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744812.863729:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475346304 00000100:00100000:2.0:1788744812.863737:0:15495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475346304 00000100:00100000:2.0:1788744812.863794:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744812.863803:0:15495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475346304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744812.863851:0:15495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475346304:12345-0@lo:400:kworker.0 Request processed in 50us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744812.863858:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744812.863897:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475346304:0@lo:400:kworker.0 00000100:00100000:3.0:1788744812.864195:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475346560 00000100:00100000:3.0:1788744812.864222:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475346560 00000100:00100000:3.0:1788744812.864578:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475346432 00000100:00100000:3.0:1788744812.864583:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475346432 00000100:00100000:3.0:1788744812.864602:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744812.864610:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475346560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744812.864661:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875634475346560:12345-0@lo:400:kworker.0 Request processed in 52us (10392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744812.864667:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744812.864684:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788744812.864689:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634475346432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744812.864718:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634475346432:12345-0@lo:400:kworker.0 Request processed in 29us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744812.864724:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788744812.864759:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875634475346560:0@lo:400:kworker.0 00000100:00100000:3.0:1788744812.864781:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634475346432:0@lo:400:kworker.0 00000100:00100000:3.0:1788744812.864820:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744812.864826:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475346688:0@lo:400:kworker.0 00000100:00100000:3.0:1788744812.864856:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744812.864878:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475346688 00000100:00100000:3.0:1788744812.864882:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475346688 00000100:00100000:3.0:1788744812.864911:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744812.864917:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475346688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744812.864947:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875634475346688:12345-0@lo:400:kworker.0 Request processed in 31us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744812.864953:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744812.864977:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875634475346688:0@lo:400:kworker.0 00000100:00100000:0.0:1788744812.865765:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a239458850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85c0995c-9591-4016-879e-a5185771e142+19:3308:x1875634475346176:12345-0@lo:400:kworker.0 Request processed in 11222us (12208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744812.865776:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788744812.871858:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744812.871892:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a1069b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475346816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744812.871977:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744812.872726:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475346816 00000100:00100000:3.0:1788744812.872734:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475346816 00000100:00100000:3.0:1788744812.872777:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744812.872785:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c07a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475346816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744812.872827:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744812.872889:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c07a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634475346816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744812.872896:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744812.872957:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a1069b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875634475346816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744812.879011:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:85c0995c-9591-4016-879e-a5185771e142:3308:1875634475346176:0@lo:400:kworker.0 00000100:00080000:1.0:1788744812.879109:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744812.879119:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788744812.998386:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1788744813.003252:0:15056:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:2.0:1788744813.003262:0:15056:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:2.0:1788744813.003278:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb3935e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744813.003291:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb3935e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744813.003300:0:15056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb3935e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744813.003322:0:15056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051bc00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744813.003328:0:15056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb3935e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744813.003336:0:15056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb3935e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744813.003357:0:15056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb3935e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744813.003366:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a78beee/0x4b162761eb3935e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744813.003488:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+13:2360:x1875634451247104:12345-192.168.201.6@tcp:4:dd.0 Request processed in 177714us (491912us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788744813.003497:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:2.0:1788744813.003538:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:2.0:1788744813.003551:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+12:2360:x1875634451247488:12345-192.168.201.6@tcp:4:dd.0 00010000:00010000:2.0:1788744813.003589:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021e9450c/0x4b162761eb3935f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744813.003603:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744813.003607:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744813.003613:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021e9450c/0x4b162761eb3935f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744813.003637:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021e9450c/0x4b162761eb3935f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744813.104825:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:0.0:1788744813.105161:0:16599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00010000:00010000:0.0:1788744813.105188:0:16599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aa9cfe7/0x4b162761eb3935eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744813.105203:0:16599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aa9cfe7/0x4b162761eb3935eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744813.105213:0:16599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aa9cfe7/0x4b162761eb3935eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744813.105221:0:16599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a210599600 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744813.105226:0:16599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aa9cfe7/0x4b162761eb3935eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744813.105256:0:16599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aa9cfe7/0x4b162761eb3935eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744813.105278:0:16599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aa9cfe7/0x4b162761eb3935eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744813.105287:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aa9cfe7/0x4b162761eb3935eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744813.105383:0:16599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:048fcf10-bca2-4fd1-9809-4e3b531d6735+12:2360:x1875634451247360:12345-192.168.201.6@tcp:4:dd.0 Request processed in 261340us (265091us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788744813.105393:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:0.0:1788744813.105433:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:0.0:1788744813.105453:0:16599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:048fcf10-bca2-4fd1-9809-4e3b531d6735+11:2360:x1875634451247616:12345-192.168.201.6@tcp:4:dd.0 00010000:00010000:1.0:1788744813.107482:0:16599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f890ad31/0x4b162761eb3935f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744813.107504:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744813.107509:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744813.107515:0:16599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f890ad31/0x4b162761eb3935f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744813.107528:0:16599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f890ad31/0x4b162761eb3935f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744813.150227:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:2.0:1788744813.150837:0:15056:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:2.0:1788744813.150845:0:15056:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:2.0:1788744813.150862:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021e9450c/0x4b162761eb3935f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744813.150877:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021e9450c/0x4b162761eb3935f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744813.150887:0:15056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021e9450c/0x4b162761eb3935f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744813.150895:0:15056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2c00 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:2.0:1788744813.150901:0:15056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021e9450c/0x4b162761eb3935f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744813.150910:0:15056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021e9450c/0x4b162761eb3935f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744813.150934:0:15056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021e9450c/0x4b162761eb3935f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744813.150942:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021e9450c/0x4b162761eb3935f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744813.151062:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+11:2360:x1875634451247488:12345-192.168.201.6@tcp:4:dd.0 Request processed in 147510us (310721us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1788744813.151072:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:2.0:1788744813.151104:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:2.0:1788744813.151116:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+10:2360:x1875634451247744:12345-192.168.201.6@tcp:4:dd.0 00010000:00010000:2.0:1788744813.151198:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb393600 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744813.151212:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744813.151217:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744813.151222:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb393600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744813.151235:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb393600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744813.194032:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:3.0:1788744813.194475:0:16599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1788744813.194480:0:16599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1788744813.194497:0:16599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f890ad31/0x4b162761eb3935f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744813.194511:0:16599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f890ad31/0x4b162761eb3935f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744813.194521:0:16599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f890ad31/0x4b162761eb3935f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744813.194528:0:16599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a210599400 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744813.194533:0:16599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f890ad31/0x4b162761eb3935f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744813.194553:0:16599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f890ad31/0x4b162761eb3935f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744813.194574:0:16599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f890ad31/0x4b162761eb3935f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744813.194583:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f890ad31/0x4b162761eb3935f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744813.194677:0:16599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:048fcf10-bca2-4fd1-9809-4e3b531d6735+10:2360:x1875634451247616:12345-192.168.201.6@tcp:4:dd.0 Request processed in 89231us (354306us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788744813.194687:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:3.0:1788744813.194717:0:16599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1788744813.194730:0:16599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23b4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:048fcf10-bca2-4fd1-9809-4e3b531d6735+9:2360:x1875634451247872:12345-192.168.201.6@tcp:4:dd.0 00010000:00010000:3.0:1788744813.194761:0:16599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb393607 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744813.194774:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744813.194778:0:16599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744813.194785:0:16599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb393607 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744813.194797:0:16599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb393607 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744813.242357:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:0.0:1788744813.242583:0:15056:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1788744813.242588:0:15056:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1788744813.242603:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb393600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744813.242684:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb393600 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744813.242696:0:15056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb393600 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744813.242727:0:15056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a2064f2200 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:0.0:1788744813.242732:0:15056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb393600 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744813.242742:0:15056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb393600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744813.242762:0:15056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb393600 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744813.242771:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c2b4f40/0x4b162761eb393600 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744813.242909:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:048fcf10-bca2-4fd1-9809-4e3b531d6735+9:2360:x1875634451247744:12345-192.168.201.6@tcp:4:dd.0 Request processed in 91791us (402514us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788744813.242920:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000001:00080000:2.0:1788744813.297590:0:6709:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:3.0:1788744813.297833:0:16599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1788744813.297854:0:16599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb393607 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744813.297873:0:16599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb393607 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744813.297884:0:16599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb393607 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744813.297893:0:16599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93a23051b000 already unused, calling callback (ffffffffc15e58d0) 00010000:00010000:3.0:1788744813.297898:0:16599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb393607 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744813.297906:0:16599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb393607 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744813.297929:0:16599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb393607 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744813.297936:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b1b5feb/0x4b162761eb393607 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744813.298034:0:16599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23b4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:2360:x1875634451247872:12345-192.168.201.6@tcp:4:dd.0 Request processed in 103301us (457623us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788744813.298057:0:16599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00010000:00010000:2.0:1788744813.748948:0:14354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744814.786413:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788744815.175931:0:16637:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1788744815.525732:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744815.525772:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744815.525794:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744815.525834:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744815.525852:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744815.525868:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788744815.525885:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788744815.525954:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451248128 00000100:00100000:3.0:1788744815.525965:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451248128 00000100:00100000:3.0:1788744815.526045:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451248512 00000100:00100000:3.0:1788744815.526048:0:14366:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451248512 00000100:00100000:3.0:1788744815.526069:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:3.0:1788744815.526078:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+20:2361:x1875634451248128:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744815.526196:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+20:2361:x1875634451248128:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 118us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744815.526204:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:3.0:1788744815.526223:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:3.0:1788744815.526229:0:14366:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:2361:x1875634451248512:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744815.526257:0:14366:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+6:2361:x1875634451248512:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 28us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744815.526264:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:3.0:1788744815.526285:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451248384 00000100:00100000:3.0:1788744815.526289:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451248384 00000100:00100000:3.0:1788744815.526308:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451248640 00000100:00100000:3.0:1788744815.526310:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451248640 00000100:00100000:3.0:1788744815.526321:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451248256 00000100:00100000:3.0:1788744815.526323:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451248256 00000100:00100000:3.0:1788744815.526333:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451248768 00000100:00100000:3.0:1788744815.526335:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451248768 00000100:00100000:3.0:1788744815.526349:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1788744815.526355:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:2361:x1875634451248384:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744815.526399:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:2361:x1875634451248384:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 43us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744815.526405:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1788744815.526418:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:3.0:1788744815.526425:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+5:2361:x1875634451248640:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744815.526449:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+5:2361:x1875634451248640:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 25us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744815.526455:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:3.0:1788744815.526467:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:3.0:1788744815.526473:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:2361:x1875634451248256:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744815.526496:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:048fcf10-bca2-4fd1-9809-4e3b531d6735+5:2361:x1875634451248256:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 23us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744815.526501:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:3.0:1788744815.526512:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1788744815.526518:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a1069b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+5:2361:x1875634451248768:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788744815.526541:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a1069b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c3b47ab3-c6f9-48d4-974c-c1f83c9f7f15+5:2361:x1875634451248768:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 23us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744815.526547:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00080000:0.0:1788744815.526798:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744815.526803:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744815.526805:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744815.528473:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634451248000 00000100:00100000:2.0:1788744815.528488:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634451248000 00000100:00100000:2.0:1788744815.528562:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:2.0:1788744815.528836:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23945b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:2361:x1875634451248000:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788744815.528925:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23945b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02e5aaad-21c4-4c17-8f29-5f47c1c09893+13:2361:x1875634451248000:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 96us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744815.528935:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 123 00010000:00010000:1.0:1788744815.796294:0:15500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744815.924360:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744815.924393:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93a23c07b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475346944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744815.924459:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744815.924531:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634475346944 00000100:00100000:3.0:1788744815.924539:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634475346944 00000100:00100000:3.0:1788744815.924595:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744815.924612:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff93a23c079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475346944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744815.924651:0:15052:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 8519680 granted 64684032 pending 0 free 3851419648 avail 3849322496 00000100:00080000:1.0:1788744815.924676:0:14362:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744815.924699:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff93a23c079500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634475346944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744815.924707:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744815.924743:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1788744815.924761:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93a23b4c3b80, transno 8589934595 00000004:00080000:3.0:1788744815.924782:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1788744815.924808:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93a23c07b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875634475346944:0@lo:13:osp-pre-0-0.0 Debug log: 29487 lines, 29487 kept, 0 dropped, 0 bad.